Sep 08 19:09:12 devstack cinder-volume[76541]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 19:09:12 devstack cinder-volume[76541]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 19:09:12 devstack cinder-volume[76541]: we strongly recommend against using it for new projects. Sep 08 19:09:12 devstack cinder-volume[76541]: If you are already using Eventlet, we recommend migrating to a different Sep 08 19:09:12 devstack cinder-volume[76541]: framework. For more detail see Sep 08 19:09:12 devstack cinder-volume[76541]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 19:09:12 devstack cinder-volume[76541]: import eventlet # noqa Sep 08 19:09:15 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:09:15 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:09:15 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:09:16 devstack cinder-volume[76541]: INFO dbcounter [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Registered counter for database cinder Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG oslo_db.sqlalchemy.engines [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG dbcounter [-] [76541] Writer thread running {{(pid=76541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:09:16 devstack cinder-volume[76541]: INFO cinder.rpc [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 19:09:16 devstack cinder-volume[76541]: INFO cinder.rpc [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG oslo_db.sqlalchemy.engines [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:09:16 devstack cinder-volume[76541]: INFO cinder.volume.manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Determined volume DB was empty at startup. Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG cinder.volume.manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76541) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 19:09:16 devstack cinder-volume[76541]: INFO cinder.volume.manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 19:09:16 devstack cinder-volume[76541]: WARNING stevedore.named [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 19:09:16 devstack cinder-volume[76541]: WARNING castellan.key_manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:09:16 devstack cinder-volume[76541]: WARNING cinder.keymgr.conf_key_mgr [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG cinder.volume.drivers.lvm [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76541) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 08 19:09:16 devstack cinder-volume[76541]: DEBUG oslo_concurrency.processutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_concurrency.processutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] CMD "cinder-rtstool verify" returned: 0 in 0.418s {{(pid=76541) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_db.sqlalchemy.engines [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:09:17 devstack cinder-volume[76541]: INFO cinder.rpc [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 08 19:09:17 devstack cinder-volume[76541]: INFO cinder.rpc [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 08 19:09:17 devstack cinder-volume[76541]: WARNING stevedore.named [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 19:09:17 devstack cinder-volume[76541]: WARNING castellan.key_manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:09:17 devstack cinder-volume[76541]: INFO cinder.volume.manager [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_db.sqlalchemy.engines [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:09:17 devstack cinder-volume[76541]: INFO oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Starting 1 workers Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Started child 76698 {{(pid=76541) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Full set of CONF: {{(pid=76541) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] ******************************************************************************** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Configuration options gathered from: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] ================================================================================ {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] allow_availability_zone_fallback = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] allow_compression_on_image_upload = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] allowed_direct_url_schemes = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] api_rate_limit = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] auth_strategy = keystone {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] az_cache_duration = 3600 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_availability_zone = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_host = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_stats_polling_interval = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backup_api_class = cinder.backup.api.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backup_name_template = backup-%s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backup_use_same_host = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backup_use_temp_snapshot = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] chap_password = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] chap_username = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_internal_tenant_project_id = c058fb765bf745cca8fede1f27454711 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_internal_tenant_user_id = 0ed4fd0de9fa4b858f13d40dd43372cf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cloned_volume_same_az = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cluster = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] compression_format = gzip {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] compute_api_class = cinder.compute.nova.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] config_dir = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] config_source = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76698]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] control_exchange = openstack {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] debug = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] default_availability_zone = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] default_group_type = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] default_volume_type = lvmdriver-1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] disk_geometry = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_client_cert = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_client_cert_key = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_data_namespace = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_ssl_cert_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_ssl_cert_verify = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] driver_use_ssl = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] enable_force_upload = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] enable_new_services = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] enable_unsupported_driver = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] enforce_multipath_for_image_xfer = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] filter_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_api_insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_api_ssl_compression = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_ca_certificates_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_catalog_info = image:glance:publicURL {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_num_retries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance_request_timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] goodness_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] graceful_shutdown_timeout = 5 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] group_api_class = cinder.group.api.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] host = devstack {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_compress_on_upload = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_conversion_address_space_limit = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_conversion_cpu_limit = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_conversion_disable = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_upload_use_cinder_backend = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_upload_use_internal_tenant = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_volume_cache_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_volume_cache_max_count = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] image_volume_cache_max_size_gb = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] init_host_max_objects_retrieval = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] instance_format = [instance: %(uuid)s] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iscsi_target_flags = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iscsi_write_cache = on {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iser_helper = tgtadm {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iser_ip_address = 192.168.122.225 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iser_port = 3260 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_color = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_config_append = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_dir = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_options = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_rotate_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_rotate_interval_type = days {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] log_rotation_type = none {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] max_age = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] max_logfile_count = 30 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] max_logfile_size_mb = 200 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] max_over_subscription_ratio = 20.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] message_reap_interval = 86400 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] message_ttl = 2592000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] migration_create_volume_timeout_secs = 300 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] monkey_patch = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] monkey_patch_modules = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] my_ip = 192.168.122.225 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] no_snapshot_gb_quota = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] num_iser_scan_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] num_shell_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] num_volume_device_scan_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] nvmeof_conn_info_version = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] nvmet_ns_id = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] nvmet_port_id = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_max_limit = 1000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_ext_list = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_listen_port = 8776 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_use_ssl = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] osapi_volume_workers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] per_volume_size_limit = -1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] periodic_fuzzy_delay = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] periodic_interval = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] public_endpoint = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] publish_errors = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_backup_gigabytes = 1000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_backups = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_gigabytes = 1000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_groups = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_snapshots = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] quota_volumes = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] rate_limit_burst = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] rate_limit_except_level = CRITICAL {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] rate_limit_interval = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] reinit_driver_count = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] replication_device = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] report_discard_supported = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] report_interval = 120 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] reservation_clean_interval = 86400 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] reservation_expire = 86400 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] reserved_image_namespaces = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] reserved_percentage = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] rpc_response_timeout = 120 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] run_external_periodic_tasks = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] scst_target_driver = iscsi {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] scst_target_iqn_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_down_time = 720 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] shell_completion = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] snapshot_name_template = snapshot-%s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] snapshot_same_host = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] split_loggers = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] state_path = /opt/stack/data/cinder {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] storage_availability_zone = nova {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] storage_protocol = iSCSI {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] syslog_log_facility = LOG_USER {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_helper = lioadm {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_ip_address = 192.168.122.225 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_port = 3260 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_protocol = iscsi {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] target_secondary_ip_addresses = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] trace_flags = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] transport_url = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] until_refresh = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_chap_auth = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_default_quota_class = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_journal = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_json = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_multipath_for_image_xfer = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_stderr = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] use_syslog = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] verify_glance_signatures = enabled {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_api_class = cinder.volume.api.API {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_backend_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_clear = zero {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_clear_ionice = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_clear_size = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_copy_bps_limit = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_dd_blocksize = 1M {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_name_template = volume-%s {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_service_inithost_offload = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volume_usage_audit_period = month {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] zoning_mode = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_concurrency.disable_process_locking = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.auth_section = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.auth_type = password {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.auth_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.cache = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.include_service_catalog = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.interface = public {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_password = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcache_username = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.region_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.service_type = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.backend = dogpile.cache.null {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.backend_argument = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.backend_expiration_time = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.config_prefix = cache.oslo {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.debug_cache_backend = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.enable_retry_client = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.enable_socket_keepalive = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.expiration_time = 600 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.hashclient_retry_attempts = 2 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_dead_retry = 300 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_pool_maxsize = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_sasl_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.password = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.proxies = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.redis_db = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.redis_server = localhost:6379 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.retry_attempts = 2 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.retry_delay = 0.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.socket_keepalive_count = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.socket_keepalive_idle = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.socket_keepalive_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.socket_timeout = 1.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.tls_allowed_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.tls_cafile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.tls_certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.tls_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.tls_keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cache.username = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] coordination.backend_url = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.asyncio_connection = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.asyncio_slave_connection = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.backend = sqlalchemy {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.connection = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.connection_debug = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.connection_parameters = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.connection_recycle_time = 3600 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.connection_trace = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.db_inc_retry_interval = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.db_max_retries = 20 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.db_max_retry_interval = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.db_retry_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.max_overflow = 50 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: INFO cinder.volume.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.max_pool_size = 5 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.max_retries = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.mysql_wsrep_sync_wait = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.pool_timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.retry_interval = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.slave_connection = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.sqlite_synchronous = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.synchronous_reader = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] database.use_db_reconnect = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_tracing.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.connection_string = messaging:// {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.es_doc_type = notification {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.es_scroll_size = 10000 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.es_scroll_time = 2m {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.filter_error_trace = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.hmac_keys = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.sentinel_service_name = mymaster {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.socket_timeout = 0.1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.trace_requests = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler.trace_sqlalchemy = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler_jaeger.process_tags = {} {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler_jaeger.service_name_prefix = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] profiler_otlp.service_name_prefix = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.enforce_new_defaults = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.policy_default_rule = default {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.policy_file = policy.yaml {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.group = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.helper_command = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] privsep_osbrick.user = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.group = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.helper_command = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] cinder_sys_admin.user = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.auth_section = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.auth_type = password {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.cafile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.collect_timing = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.send_service_user_token = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.split_loggers = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.tls_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] service_user.tls_min_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.auth_section = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.auth_type = password {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.collect_timing = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.region_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.split_loggers = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.tls_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] glance.tls_min_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.backend_availability_zone = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.chap_password = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.chap_username = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.disk_geometry = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_client_cert = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_client_cert_key = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_data_namespace = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.driver_use_ssl = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.extra_capabilities = {} {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.filter_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.goodness_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iscsi_target_flags = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iscsi_write_cache = on {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iser_helper = tgtadm {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iser_port = 3260 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.lvm_share_target = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.lvm_type = auto {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.num_shell_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.replication_device = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.report_discard_supported = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.reserved_percentage = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_helper = tgtadm {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_port = 3260 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_protocol = iscsi {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.trace_flags = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.unique_fqdn_network = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.use_chap_auth = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_backend_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_clear = zero {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_clear_ionice = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_clear_size = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_reports.file_event_handler = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_reports.log_dir = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.backend_host = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.chap_password = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.chap_username = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.disk_geometry = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_client_cert = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.extra_capabilities = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.filter_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.goodness_function = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iser_helper = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iser_ip_address = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iser_port = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.lvm_share_target = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.lvm_type = auto {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.num_shell_tries = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.replication_device = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.report_discard_supported = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.reserved_percentage = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.scst_target_driver = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.storage_protocol = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_helper = lioadm {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_ip_address = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_port = 3260 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.trace_flags = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.use_chap_auth = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_clear = zero {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_clear_size = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] lvmdriver-1.volumes_dir = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_notifications.driver = [] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_notifications.retry = -1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] key_manager.fixed_key = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.barbican_api_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.barbican_endpoint = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.barbican_endpoint_type = public {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.barbican_region_name = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.cafile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.collect_timing = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.number_of_retries = 60 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.retry_delay = 1 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.send_service_user_token = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.split_loggers = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.tls_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.tls_min_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.verify_ssl = True {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican.verify_ssl_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.auth_section = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.auth_type = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.cafile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.certfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.collect_timing = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.insecure = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.keyfile = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.split_loggers = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.timeout = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.tls_ciphers = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] barbican_service_user.tls_min_version = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.approle_role_id = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.approle_secret_id = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.auth_method = approle {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.049s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.auth_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.kv_mountpoint = secret {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.kv_path = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.kv_version = 2 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.namespace = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.root_token_id = **** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.ssl_ca_crt_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.timeout = 60.0 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.token_file = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.token_role = None {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.use_ssl = False {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:09:17 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] ******************************************************************************** {{(pid=76541) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 19:09:17 devstack sudo[76704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 08 19:09:17 devstack sudo[76704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:17 devstack sudo[76704]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack sudo[76822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:18 devstack sudo[76822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:18 devstack sudo[76822]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.287s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:09:18 devstack cinder-volume[76698]: INFO cinder.brick.local_dev.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack sudo[76900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:18 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:18 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG cinder.brick.local_dev.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76698) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 08 19:09:18 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:18 devstack sudo[76989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:18 devstack sudo[76989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[76989]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[77165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:19 devstack sudo[77165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[77165]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[77260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 08 19:09:19 devstack sudo[77260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[77260]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.315s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:19 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:19 devstack sudo[77314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:19 devstack sudo[77314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:19 devstack sudo[77314]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:20 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:20 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack sudo[77401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:20 devstack sudo[77401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:20 devstack sudo[77401]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack sudo[77420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:20 devstack sudo[77420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:20 devstack sudo[77420]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:20 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:20 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:20 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:21 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:21 devstack cinder-volume[76698]: INFO cinder.volume.drivers.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:21 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:21 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack sudo[77507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:21 devstack sudo[77507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:21 devstack sudo[77507]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:21 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:21 devstack sudo[77510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:21 devstack sudo[77510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:22 devstack sudo[77510]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:22 devstack sudo[77513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:22 devstack sudo[77513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:22 devstack sudo[77513]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:22 devstack sudo[77516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:22 devstack sudo[77516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:22 devstack sudo[77516]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:22 devstack cinder-volume[76698]: INFO cinder.volume.driver [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG cinder.volume.driver [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76698) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_db.sqlalchemy.engines [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76698) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writer thread running {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG cinder.db.api [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Building query based on filter {{(pid=76698) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG cinder.image.image_utils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76698) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 19:09:22 devstack cinder-volume[76698]: INFO cinder.keymgr.migration [None req-f857f85c-c7ce-42f1-9be2-600639174002 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:22 devstack sudo[77519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:22 devstack sudo[77519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:22 devstack sudo[77519]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:22 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:23 devstack sudo[77524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:23 devstack sudo[77524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:23 devstack sudo[77524]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:23 devstack sudo[77561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:23 devstack sudo[77561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:23 devstack sudo[77561]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:23 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:23 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:23 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG cinder.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Notifying Schedulers of capabilities ... {{(pid=76698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:09:23 devstack cinder-volume[76698]: INFO cinder.volume.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Driver initialization completed successfully. Sep 08 19:09:23 devstack cinder-volume[76698]: INFO cinder.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Initiating service 2 cleanup Sep 08 19:09:23 devstack cinder-volume[76698]: INFO cinder.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Service 2 cleanup completed. Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG cinder.service [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Creating RPC server for service cinder-volume {{(pid=76698) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 19:09:23 devstack cinder-volume[76698]: DEBUG cinder.service [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76698) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 19:09:24 devstack cinder-volume[76698]: INFO cinder.volume.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:24 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:09:24 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:24 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:24 devstack sudo[77576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:24 devstack sudo[77576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:24 devstack sudo[77576]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:24 devstack sudo[77581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:09:24 devstack sudo[77581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:24 devstack sudo[77581]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:24 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:09:24 devstack sudo[77584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:09:24 devstack sudo[77584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:09:25 devstack sudo[77584]: pam_unix(sudo:session): session closed for user root Sep 08 19:09:25 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:09:25 devstack cinder-volume[76698]: INFO cinder.volume.manager [None req-569b81e1-c23c-4dcc-ad3e-4daa868f76a4 None None] Driver post RPC initialization completed successfully. Sep 08 19:09:27 devstack cinder-volume[76541]: DEBUG dbcounter [-] [76541] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76541) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:09:33 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:09:35 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:09:43 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager._thread_info {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:09:43 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread count: 6 {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:09:43 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread info: [<_MainThread(MainThread, started 140088550019200)>, , , , , ] {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:43 devstack sudo[80204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:10:43 devstack sudo[80204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:43 devstack sudo[80204]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:43 devstack sudo[80213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:10:43 devstack sudo[80213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:43 devstack sudo[80213]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:43 devstack sudo[80216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:10:43 devstack sudo[80216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:43 devstack sudo[80216]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:10:43 devstack sudo[80219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:10:43 devstack sudo[80219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:10:44 devstack sudo[80219]: pam_unix(sudo:session): session closed for user root Sep 08 19:10:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:10:44 devstack cinder-volume[76698]: DEBUG cinder.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Notifying Schedulers of capabilities ... {{(pid=76698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:10:44 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager._thread_info {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:10:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread count: 6 {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:10:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread info: [<_MainThread(MainThread, started 140088550019200)>, , , , , ] {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:11:35 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:SELECT=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:11:35 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:UPDATE=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:43 devstack sudo[83203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:11:43 devstack sudo[83203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:43 devstack sudo[83203]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:43 devstack sudo[83206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:11:43 devstack sudo[83206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:43 devstack sudo[83206]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:43 devstack sudo[83209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:11:43 devstack sudo[83209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:43 devstack sudo[83209]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:11:43 devstack sudo[83212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:11:43 devstack sudo[83212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:11:44 devstack sudo[83212]: pam_unix(sudo:session): session closed for user root Sep 08 19:11:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:11:44 devstack cinder-volume[76698]: DEBUG cinder.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Notifying Schedulers of capabilities ... {{(pid=76698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:12:43 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:12:43 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:12:43 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:43 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:12:43 devstack sudo[85478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:12:43 devstack sudo[85478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:12:44 devstack sudo[85478]: pam_unix(sudo:session): session closed for user root Sep 08 19:12:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:12:44 devstack cinder-volume[76698]: DEBUG cinder.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Notifying Schedulers of capabilities ... {{(pid=76698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:12:44 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager._thread_info {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:12:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread count: 6 {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:12:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread info: [<_MainThread(MainThread, started 140088550019200)>, , , , , ] {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:13:35 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:SELECT=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:13:35 devstack cinder-volume[76698]: DEBUG dbcounter [-] [76698] Writing DB stats cinder:UPDATE=1 {{(pid=76698) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:13:42 devstack cinder-volume[76541]: INFO oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Caught SIGTERM, stopping children Sep 08 19:13:42 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Acquiring lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:13:42 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Acquired lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:13:42 devstack cinder-volume[76541]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Releasing lock "singleton_lock" {{(pid=76541) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:13:42 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Stop services. {{(pid=76541) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 19:13:42 devstack cinder-volume[76541]: DEBUG oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Killing children. {{(pid=76541) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 19:13:42 devstack cinder-volume[76541]: INFO oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Waiting on 1 children to exit Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG cinder.volume.drivers.lvm [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Updating volume stats {{(pid=76698) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 08 19:13:43 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:43 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:13:43 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:43 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 08 19:13:43 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:43 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:43 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:43 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 08 19:13:43 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:44 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.processutils [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76698) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG cinder.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Notifying Schedulers of capabilities ... {{(pid=76698) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG oslo_service.periodic_task [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] Running periodic task VolumeManager._thread_info {{(pid=76698) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread count: 5 {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG cinder.volume.manager [None req-84c008e3-3512-4cb2-aee2-eab0c8979c8e None None] thread info: [<_MainThread(MainThread, started 140088550019200)>, , , , ] {{(pid=76698) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Acquiring lock "singleton_lock" {{(pid=76698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Acquired lock "singleton_lock" {{(pid=76698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:13:44 devstack cinder-volume[76698]: DEBUG oslo_concurrency.lockutils [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Releasing lock "singleton_lock" {{(pid=76698) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:13:44 devstack cinder-volume[76698]: WARNING amqp [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 19:13:44 devstack cinder-volume[76698]: WARNING amqp [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 19:13:44 devstack cinder-volume[76541]: INFO oslo_service.backend._eventlet.service [None req-5d00340c-b671-449b-8ab6-02a6a5f8387b None None] Child 76698 exited with status 0 Sep 08 19:13:44 devstack cinder-volume[86717]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 19:13:44 devstack cinder-volume[86717]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 19:13:44 devstack cinder-volume[86717]: we strongly recommend against using it for new projects. Sep 08 19:13:44 devstack cinder-volume[86717]: If you are already using Eventlet, we recommend migrating to a different Sep 08 19:13:44 devstack cinder-volume[86717]: framework. For more detail see Sep 08 19:13:44 devstack cinder-volume[86717]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 19:13:44 devstack cinder-volume[86717]: import eventlet # noqa Sep 08 19:13:46 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:13:46 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:13:46 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:13:47 devstack cinder-volume[86717]: INFO dbcounter [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Registered counter for database cinder Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG dbcounter [-] [86717] Writer thread running {{(pid=86717) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:13:47 devstack cinder-volume[86717]: INFO cinder.rpc [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 19:13:47 devstack cinder-volume[86717]: INFO cinder.rpc [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:13:47 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Determined volume DB was empty at startup. Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG cinder.volume.manager [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86717) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 19:13:47 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 08 19:13:47 devstack cinder-volume[86717]: WARNING stevedore.named [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 19:13:47 devstack cinder-volume[86717]: WARNING castellan.key_manager [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:13:47 devstack cinder-volume[86717]: WARNING cinder.keymgr.conf_key_mgr [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:13:47 devstack cinder-volume[86717]: INFO cinder.volume.manager [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_db.sqlalchemy.engines [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86717) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:13:47 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Starting 1 workers Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Started child 86934 {{(pid=86717) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Full set of CONF: {{(pid=86717) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] ******************************************************************************** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Configuration options gathered from: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] ================================================================================ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 19:13:47 devstack cinder-volume[86934]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] allow_availability_zone_fallback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] allow_compression_on_image_upload = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] allowed_direct_url_schemes = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] api_rate_limit = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] auth_strategy = keystone {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_stats_polling_interval = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backup_api_class = cinder.backup.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backup_name_template = backup-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backup_use_same_host = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backup_use_temp_snapshot = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] chap_username = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_internal_tenant_project_id = c058fb765bf745cca8fede1f27454711 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_internal_tenant_user_id = 0ed4fd0de9fa4b858f13d40dd43372cf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cluster = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] compression_format = gzip {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] compute_api_class = cinder.compute.nova.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] config_dir = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] config_source = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] control_exchange = openstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] debug = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] default_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] default_group_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] default_volume_type = QuobyteHD {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:47 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_ssl_cert_verify = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] driver_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] enable_new_services = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] enable_unsupported_driver = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] enabled_backends = ['QuobyteHD'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] enforce_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_api_insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_api_ssl_compression = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_ca_certificates_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_catalog_info = image:glance:publicURL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_num_retries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance_request_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] graceful_shutdown_timeout = 5 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] group_api_class = cinder.group.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] host = devstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_compress_on_upload = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_conversion_address_space_limit = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_conversion_cpu_limit = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_conversion_disable = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_upload_use_cinder_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_upload_use_internal_tenant = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_volume_cache_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_volume_cache_max_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] image_volume_cache_max_size_gb = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] init_host_max_objects_retrieval = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] instance_format = [instance: %(uuid)s] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iscsi_target_flags = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iscsi_write_cache = on {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iser_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iser_ip_address = 192.168.122.225 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iser_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_color = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_config_append = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_options = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_rotate_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_rotate_interval_type = days {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] log_rotation_type = none {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] max_age = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] max_logfile_count = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.remotefs [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86934) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] max_logfile_size_mb = 200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] max_over_subscription_ratio = 20.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] message_reap_interval = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] message_ttl = 2592000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] migration_create_volume_timeout_secs = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] monkey_patch = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] monkey_patch_modules = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] my_ip = 192.168.122.225 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] no_snapshot_gb_quota = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] num_iser_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] num_shell_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] num_volume_device_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] nvmeof_conn_info_version = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] nvmet_ns_id = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] nvmet_port_id = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_max_limit = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_ext_list = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_listen_port = 8776 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] osapi_volume_workers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] per_volume_size_limit = -1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] periodic_fuzzy_delay = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] periodic_interval = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] public_endpoint = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] publish_errors = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_backup_gigabytes = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_backups = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_gigabytes = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_groups = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_snapshots = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] quota_volumes = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] rate_limit_burst = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] rate_limit_except_level = CRITICAL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] rate_limit_interval = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] reinit_driver_count = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] report_discard_supported = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] report_interval = 120 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] reservation_clean_interval = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] reservation_expire = 86400 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] reserved_image_namespaces = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] reserved_percentage = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] rpc_response_timeout = 120 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] run_external_periodic_tasks = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] scst_target_driver = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_down_time = 720 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] shell_completion = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] snapshot_name_template = snapshot-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] state_path = /opt/stack/data/cinder {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] storage_availability_zone = nova {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] storage_protocol = iSCSI {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] syslog_log_facility = LOG_USER {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_helper = lioadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_ip_address = 192.168.122.225 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_protocol = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] target_secondary_ip_addresses = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] transport_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] until_refresh = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_chap_auth = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_default_quota_class = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_journal = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_json = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_stderr = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] use_syslog = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] verify_glance_signatures = enabled {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_api_class = cinder.volume.api.API {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_clear = zero {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_clear_size = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_copy_bps_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_dd_blocksize = 1M {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_name_template = volume-%s {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_service_inithost_offload = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volume_usage_audit_period = month {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] zoning_mode = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_concurrency.disable_process_locking = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.auth_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.include_service_catalog = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.interface = public {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcache_username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.service_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.backend = dogpile.cache.null {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.backend_argument = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.backend_expiration_time = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.config_prefix = cache.oslo {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.debug_cache_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.enable_retry_client = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.enable_socket_keepalive = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.expiration_time = 600 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.hashclient_retry_attempts = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_dead_retry = 300 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_pool_maxsize = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_sasl_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.proxies = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.redis_db = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.redis_server = localhost:6379 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.retry_attempts = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.retry_delay = 0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.socket_keepalive_count = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.socket_keepalive_idle = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86934) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 19:13:48 devstack cinder-volume[86934]: WARNING cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 19:13:48 devstack cinder-volume[86934]: WARNING cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.socket_keepalive_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.socket_timeout = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.tls_allowed_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.tls_cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.tls_certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.tls_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.tls_keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cache.username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] coordination.backend_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Running cmd (subprocess): mount.quobyte {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.asyncio_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.asyncio_slave_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.backend = sqlalchemy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.connection_debug = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.connection_parameters = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.connection_recycle_time = 3600 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.connection_trace = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.db_inc_retry_interval = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.db_max_retries = 20 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.db_max_retry_interval = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.db_retry_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.max_overflow = 50 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.max_pool_size = 5 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.max_retries = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.mysql_wsrep_sync_wait = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.pool_timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.retry_interval = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.slave_connection = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.sqlite_synchronous = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.synchronous_reader = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] database.use_db_reconnect = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_tracing.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.connection_string = messaging:// {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.es_doc_type = notification {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.es_scroll_size = 10000 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.es_scroll_time = 2m {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.filter_error_trace = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.hmac_keys = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.sentinel_service_name = mymaster {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.socket_timeout = 0.1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.trace_requests = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler.trace_sqlalchemy = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler_jaeger.process_tags = {} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler_jaeger.service_name_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] profiler_otlp.service_name_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.enforce_new_defaults = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.policy_default_rule = default {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.policy_file = policy.yaml {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.group = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.helper_command = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] privsep_osbrick.user = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.group = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.helper_command = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] cinder_sys_admin.user = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.send_service_user_token = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] service_user.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.auth_type = password {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] glance.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.chap_username = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.driver_use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.extra_capabilities = {} {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iscsi_target_flags = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iscsi_write_cache = on {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iser_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iser_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_host = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_login = admin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_mount_options = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_private_key = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_share_path = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.num_shell_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.quobyte_volume_url = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.report_discard_supported = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.reserved_percentage = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_helper = tgtadm {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_port = 3260 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_protocol = iscsi {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.unique_fqdn_network = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.use_chap_auth = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_backend_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_clear = zero {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_clear_size = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_reports.file_event_handler = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_reports.log_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.backend_availability_zone = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.backend_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.chap_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.chap_username = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.chiscsi_conf = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.disk_geometry = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_client_cert = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_data_namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.driver_use_ssl = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.extra_capabilities = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.filter_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.goodness_function = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iser_helper = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iser_ip_address = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iser_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.iser_target_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack quobyte-client[86935]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 19:13:48 devstack quobyte-client[86935]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_host = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_login = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_mount_options = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_password = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_private_key = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_share_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_ssh_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] CMD "mount.quobyte" returned: 1 in 0.137s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.num_shell_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.nvmet_port_id = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:48 devstack cinder-volume[86934]: INFO cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 ... Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.replication_device = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.report_discard_supported = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.reserved_percentage = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.scst_target_driver = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.storage_protocol = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 -c /etc/quobyte/client-cinder.cfg {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_helper = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_ip_address = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_port = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_prefix = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_protocol = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.trace_flags = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.use_chap_auth = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_clear = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_clear_size = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] QuobyteHD.volumes_dir = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_notifications.driver = [] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_notifications.retry = -1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] key_manager.fixed_key = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.barbican_api_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.barbican_endpoint = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.barbican_endpoint_type = public {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.barbican_region_name = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.number_of_retries = 60 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.retry_delay = 1 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.send_service_user_token = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.verify_ssl = True {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican.verify_ssl_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.auth_section = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.auth_type = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.cafile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.certfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.collect_timing = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.insecure = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.keyfile = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.split_loggers = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.timeout = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.tls_ciphers = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] barbican_service_user.tls_min_version = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.approle_role_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.approle_secret_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.auth_method = approle {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.auth_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.kv_mountpoint = secret {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.kv_path = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.kv_version = 2 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.namespace = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.root_token_id = **** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.ssl_ca_crt_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.timeout = 60.0 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.token_file = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.token_role = None {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.use_ssl = False {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:13:48 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] ******************************************************************************** {{(pid=86717) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 19:13:48 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 -c /etc/quobyte/client-cinder.cfg Sep 08 19:13:48 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:48 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.394s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:48 devstack cinder-volume[86934]: INFO cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 succeeded Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.415s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:48 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:13:48 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:48 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.234s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:48 devstack cinder-volume[86934]: INFO cinder.volume.driver [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Driver hasn't implemented _init_vendor_properties() Sep 08 19:13:48 devstack cinder-volume[86934]: DEBUG cinder.volume.driver [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4755859375, 'free_capacity_gb': 1773.4755859375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86934) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_db.sqlalchemy.engines [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86934) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG dbcounter [-] [86934] Writer thread running {{(pid=86934) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.db.api [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Building query based on filter {{(pid=86934) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.image.image_utils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86934) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.keymgr.migration [None req-1c374704-b4ed-4326-a9ae-7fe662badb0d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:49 devstack sudo[87013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:13:49 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:49 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.240s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Notifying Schedulers of capabilities ... {{(pid=86934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Driver initialization completed successfully. Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Initiating service 3 cleanup Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Service 3 cleanup completed. Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.service [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Creating RPC server for service cinder-volume {{(pid=86934) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.service [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86934) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:49 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:13:49 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:49 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:49 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.239s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:49 devstack cinder-volume[86934]: INFO cinder.volume.manager [None req-217d520b-32a0-4dfb-8c96-3238c649652d None None] Driver post RPC initialization completed successfully. Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=86934) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG cinder.volume.drivers.quobyte [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=86934) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86934) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:13:54 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:13:54 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:13:54 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Caught SIGTERM, stopping children Sep 08 19:13:54 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Acquiring lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:13:54 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Acquired lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:13:54 devstack cinder-volume[86717]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Releasing lock "singleton_lock" {{(pid=86717) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:13:54 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Stop services. {{(pid=86717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 08 19:13:54 devstack cinder-volume[86717]: DEBUG oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Killing children. {{(pid=86717) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 08 19:13:54 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Waiting on 1 children to exit Sep 08 19:13:54 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG oslo_concurrency.processutils [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.319s {{(pid=86934) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:13:54 devstack cinder-volume[86934]: DEBUG cinder.manager [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Notifying Schedulers of capabilities ... {{(pid=86934) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo.messaging._drivers.impl_rabbit [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Unable to connect to AMQP server on 192.168.122.225:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server [None req-18bb4202-b438-45f2-99d4-de5ec9b65ac0 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.225:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server method() Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self._producer.publish( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return _publish( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server listener(*args) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server raise error_for_code( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self.transport._send( Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.225:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Sep 08 19:13:54 devstack cinder-volume[86934]: ERROR oslo_messaging.rpc.server Sep 08 19:13:57 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Acquiring lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:13:57 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Acquired lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:13:57 devstack cinder-volume[86934]: DEBUG oslo_concurrency.lockutils [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Releasing lock "singleton_lock" {{(pid=86934) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:13:57 devstack cinder-volume[86934]: WARNING amqp [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 19:13:57 devstack cinder-volume[86934]: WARNING amqp [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 08 19:13:57 devstack cinder-volume[86717]: INFO oslo_service.backend._eventlet.service [None req-1d2072ec-1248-479c-9224-5729f9c2760c None None] Child 86934 exited with status 0 Sep 08 19:13:58 devstack cinder-volume[87220]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 08 19:13:58 devstack cinder-volume[87220]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 19:13:58 devstack cinder-volume[87220]: we strongly recommend against using it for new projects. Sep 08 19:13:58 devstack cinder-volume[87220]: If you are already using Eventlet, we recommend migrating to a different Sep 08 19:13:58 devstack cinder-volume[87220]: framework. For more detail see Sep 08 19:13:58 devstack cinder-volume[87220]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 19:13:58 devstack cinder-volume[87220]: import eventlet # noqa Sep 08 19:14:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 08 19:14:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 08 19:14:01 devstack cinder-volume[87220]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87220) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 08 19:14:01 devstack cinder-volume[87220]: INFO dbcounter [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Registered counter for database cinder Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writer thread running {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:14:02 devstack cinder-volume[87220]: INFO cinder.rpc [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 08 19:14:02 devstack cinder-volume[87220]: INFO cinder.rpc [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:14:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Determined volume DB was empty at startup. Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG cinder.volume.manager [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87220) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 08 19:14:02 devstack cinder-volume[87220]: WARNING stevedore.named [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 08 19:14:02 devstack cinder-volume[87220]: WARNING castellan.key_manager [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:14:02 devstack cinder-volume[87220]: WARNING cinder.keymgr.conf_key_mgr [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 08 19:14:02 devstack cinder-volume[87220]: INFO cinder.volume.manager [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_db.sqlalchemy.engines [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87220) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:14:02 devstack cinder-volume[87220]: INFO oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Starting 1 workers Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Started child 87521 {{(pid=87220) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Full set of CONF: {{(pid=87220) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] ******************************************************************************** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] Configuration options gathered from: {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] ================================================================================ {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] allow_availability_zone_fallback = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] allow_compression_on_image_upload = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] allowed_direct_url_schemes = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] api_rate_limit = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] auth_strategy = keystone {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_availability_zone = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_host = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87521]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_stats_polling_interval = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backup_api_class = cinder.backup.api.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backup_name_template = backup-%s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backup_use_same_host = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backup_use_temp_snapshot = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] chap_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] chap_username = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_internal_tenant_project_id = c058fb765bf745cca8fede1f27454711 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_internal_tenant_user_id = 0ed4fd0de9fa4b858f13d40dd43372cf {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cluster = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] compression_format = gzip {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] compute_api_class = cinder.compute.nova.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] config_dir = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] config_source = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] control_exchange = openstack {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] debug = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] default_availability_zone = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] default_group_type = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] default_volume_type = QuobyteHD {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] disk_geometry = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_client_cert = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_client_cert_key = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_data_namespace = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_ssl_cert_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_ssl_cert_verify = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] driver_use_ssl = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] enable_new_services = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] enable_unsupported_driver = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] enabled_backends = ['QuobyteHD'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] enforce_multipath_for_image_xfer = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] filter_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_api_insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_api_ssl_compression = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_ca_certificates_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_catalog_info = image:glance:publicURL {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_num_retries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance_request_timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] goodness_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] graceful_shutdown_timeout = 5 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] group_api_class = cinder.group.api.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] host = devstack {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_compress_on_upload = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_conversion_address_space_limit = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_conversion_cpu_limit = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_conversion_disable = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_upload_use_cinder_backend = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_upload_use_internal_tenant = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_volume_cache_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_volume_cache_max_count = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] image_volume_cache_max_size_gb = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] init_host_max_objects_retrieval = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] instance_format = [instance: %(uuid)s] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iscsi_target_flags = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iscsi_write_cache = on {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iser_helper = tgtadm {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iser_ip_address = 192.168.122.225 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iser_port = 3260 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_color = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_config_append = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_dir = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_options = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_rotate_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_rotate_interval_type = days {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] log_rotation_type = none {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] max_age = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] max_logfile_count = 30 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] max_logfile_size_mb = 200 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] max_over_subscription_ratio = 20.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] message_reap_interval = 86400 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] message_ttl = 2592000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] migration_create_volume_timeout_secs = 300 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] monkey_patch = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] monkey_patch_modules = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] my_ip = 192.168.122.225 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] no_snapshot_gb_quota = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] num_iser_scan_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] num_shell_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] num_volume_device_scan_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] nvmeof_conn_info_version = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] nvmet_ns_id = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] nvmet_port_id = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_max_limit = 1000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_ext_list = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_listen_port = 8776 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_use_ssl = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] osapi_volume_workers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] per_volume_size_limit = -1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] periodic_fuzzy_delay = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] periodic_interval = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] public_endpoint = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] publish_errors = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_backup_gigabytes = 1000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_backups = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_gigabytes = 1000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87521) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_groups = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_snapshots = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] quota_volumes = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] rate_limit_burst = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] rate_limit_except_level = CRITICAL {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] rate_limit_interval = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] reinit_driver_count = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] replication_device = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] report_discard_supported = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] report_interval = 120 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] reservation_clean_interval = 86400 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] reservation_expire = 86400 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] reserved_image_namespaces = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] reserved_percentage = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] rpc_response_timeout = 120 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] run_external_periodic_tasks = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] scst_target_driver = iscsi {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] scst_target_iqn_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_down_time = 720 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] shell_completion = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] snapshot_name_template = snapshot-%s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] split_loggers = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] state_path = /opt/stack/data/cinder {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] storage_availability_zone = nova {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] storage_protocol = iSCSI {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] syslog_log_facility = LOG_USER {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_helper = lioadm {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_ip_address = 192.168.122.225 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_port = 3260 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_protocol = iscsi {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] target_secondary_ip_addresses = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] trace_flags = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] transport_url = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] until_refresh = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_chap_auth = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_default_quota_class = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_journal = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_json = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_multipath_for_image_xfer = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_stderr = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] use_syslog = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] verify_glance_signatures = enabled {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_api_class = cinder.volume.api.API {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_backend_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_clear = zero {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_clear_ionice = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_clear_size = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_copy_bps_limit = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_dd_blocksize = 1M {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_name_template = volume-%s {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_service_inithost_offload = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volume_usage_audit_period = month {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] zoning_mode = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_concurrency.disable_process_locking = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.auth_section = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.auth_type = password {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.auth_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.cache = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.include_service_catalog = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.interface = public {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcache_username = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.region_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.service_type = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.backend = dogpile.cache.null {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.backend_argument = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.backend_expiration_time = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.config_prefix = cache.oslo {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.debug_cache_backend = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.enable_retry_client = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.enable_socket_keepalive = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.expiration_time = 600 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.hashclient_retry_attempts = 2 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_dead_retry = 300 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_pool_maxsize = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_sasl_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.proxies = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.redis_db = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.redis_server = localhost:6379 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.retry_attempts = 2 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.retry_delay = 0.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.socket_keepalive_count = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.socket_keepalive_idle = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.socket_keepalive_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.socket_timeout = 1.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.tls_allowed_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.tls_cafile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.tls_certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.tls_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.tls_keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cache.username = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] coordination.backend_url = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.asyncio_connection = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.asyncio_slave_connection = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.backend = sqlalchemy {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.connection = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.connection_debug = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.connection_parameters = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.connection_recycle_time = 3600 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.connection_trace = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.db_inc_retry_interval = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.db_max_retries = 20 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.db_max_retry_interval = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.db_retry_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.max_overflow = 50 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.max_pool_size = 5 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.max_retries = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.mysql_wsrep_sync_wait = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.pool_timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.retry_interval = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.slave_connection = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.sqlite_synchronous = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.synchronous_reader = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] database.use_db_reconnect = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_tracing.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.connection_string = messaging:// {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.es_doc_type = notification {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.es_scroll_size = 10000 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.es_scroll_time = 2m {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.filter_error_trace = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.hmac_keys = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.sentinel_service_name = mymaster {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.socket_timeout = 0.1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.trace_requests = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler.trace_sqlalchemy = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler_jaeger.process_tags = {} {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler_jaeger.service_name_prefix = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] profiler_otlp.service_name_prefix = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.enforce_new_defaults = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.policy_default_rule = default {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.policy_file = policy.yaml {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.group = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.helper_command = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] privsep_osbrick.user = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.group = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.helper_command = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] cinder_sys_admin.user = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.auth_section = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.auth_type = password {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.cafile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.collect_timing = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.send_service_user_token = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.split_loggers = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.tls_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] service_user.tls_min_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.auth_section = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.auth_type = password {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.collect_timing = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.region_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.split_loggers = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.tls_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] glance.tls_min_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.backend_availability_zone = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.chap_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.chap_username = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.disk_geometry = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_client_cert = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_client_cert_key = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_data_namespace = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.driver_use_ssl = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.extra_capabilities = {} {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.filter_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.goodness_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87521) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iscsi_target_flags = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iscsi_write_cache = on {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iser_helper = tgtadm {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 08 19:14:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iser_port = 3260 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_host = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_login = admin {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_mount_options = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_private_key = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_share_path = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Running cmd (subprocess): mount.quobyte {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.num_shell_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.quobyte_volume_url = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.replication_device = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.report_discard_supported = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.reserved_percentage = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_helper = tgtadm {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_port = 3260 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_protocol = iscsi {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.trace_flags = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.unique_fqdn_network = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.use_chap_auth = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_backend_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_clear = zero {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_clear_ionice = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_clear_size = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_reports.file_event_handler = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_reports.log_dir = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.backend_availability_zone = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.backend_host = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.chap_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.chap_username = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.chiscsi_conf = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.disk_geometry = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_client_cert = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_data_namespace = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.driver_use_ssl = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.extra_capabilities = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.filter_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.goodness_function = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iser_helper = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iser_ip_address = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iser_port = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.iser_target_prefix = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_host = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_login = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_mount_options = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_password = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_private_key = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_share_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_ssh_port = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.num_shell_tries = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.nvmet_port_id = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.replication_device = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.report_discard_supported = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.reserved_percentage = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.scst_target_driver = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.storage_protocol = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_helper = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_ip_address = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_port = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_prefix = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_protocol = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.trace_flags = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.use_chap_auth = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_clear = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_clear_size = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] QuobyteHD.volumes_dir = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_notifications.driver = [] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_notifications.retry = -1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] key_manager.fixed_key = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.barbican_api_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.barbican_endpoint = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.barbican_endpoint_type = public {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.barbican_region_name = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.cafile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.collect_timing = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.number_of_retries = 60 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.retry_delay = 1 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.send_service_user_token = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.split_loggers = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.tls_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.tls_min_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.verify_ssl = True {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican.verify_ssl_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.auth_section = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.auth_type = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.cafile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.certfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.collect_timing = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.insecure = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.keyfile = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.split_loggers = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.timeout = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.tls_ciphers = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] barbican_service_user.tls_min_version = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.approle_role_id = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.approle_secret_id = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.auth_method = approle {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.auth_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.kv_mountpoint = secret {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.kv_path = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.kv_version = 2 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.namespace = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.root_token_id = **** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.ssl_ca_crt_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.timeout = 60.0 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.token_file = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.token_role = None {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.use_ssl = False {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 08 19:14:02 devstack cinder-volume[87220]: DEBUG oslo_service.backend._eventlet.service [None req-0fe744d3-d6e5-4a62-b5af-b6a4914afe1e None None] ******************************************************************************** {{(pid=87220) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 08 19:14:02 devstack quobyte-client[87522]: Reading configuration file: /etc/quobyte/client.cfg Sep 08 19:14:02 devstack quobyte-client[87522]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:02 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:14:02 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:03 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.226s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.volume.driver [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Driver hasn't implemented _init_vendor_properties() Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.volume.driver [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4755859375, 'free_capacity_gb': 1773.4755859375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87521) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_db.sqlalchemy.engines [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87521) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writer thread running {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.db.api [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Building query based on filter {{(pid=87521) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87521) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.keymgr.migration [None req-90d16060-04b6-4c9f-8302-a0949992ce55 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 08 19:14:03 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:14:03 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:03 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.234s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Driver initialization completed successfully. Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Initiating service 3 cleanup Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Service 3 cleanup completed. Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.service [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Creating RPC server for service cinder-volume {{(pid=87521) start /opt/stack/cinder/cinder/service.py:231}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.service [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87521) start /opt/stack/cinder/cinder/service.py:237}} Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:14:03 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:14:03 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:14:03 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Sep 08 19:14:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:14:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0dfbab34-80bd-4181-99ab-e3d3934a1046 None None] Driver post RPC initialization completed successfully. Sep 08 19:14:12 devstack cinder-volume[87220]: DEBUG dbcounter [-] [87220] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87220) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=3 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:14:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:14:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 6 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:14:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Flow 'volume_create_manager' (3cdd49e0-e873-42ce-a1ab-0b81472f3d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fd3d5c-13d0-48e5-9ad3-d27cef20ebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fd3d5c-13d0-48e5-9ad3-d27cef20ebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-752429820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4f9eba-e4eb-427e-a1df-0d6575fee81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b38e0025a43450a97be577a0b0072d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:02Z,use_quota=True,user_id='c41db0f8aea04e6db315612efa276403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20903ce2-f5b4-4354-a6f5-10e4e3b9549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20903ce2-f5b4-4354-a6f5-10e4e3b9549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4972786-cc1d-4b09-8357-fc4973941430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4972786-cc1d-4b09-8357-fc4973941430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4f9eba-e4eb-427e-a1df-0d6575fee81d', 'volume_name': 'volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1acba4-5e97-4716-954b-02967f766621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1acba4-5e97-4716-954b-02967f766621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7782cb5c-3500-40af-88e3-e4301c01476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Volume ba4f9eba-e4eb-427e-a1df-0d6575fee81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d', 'volume_size': 1} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-752429820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4f9eba-e4eb-427e-a1df-0d6575fee81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b38e0025a43450a97be577a0b0072d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:02Z,use_quota=True,user_id='c41db0f8aea04e6db315612efa276403',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Creating volume ba4f9eba-e4eb-427e-a1df-0d6575fee81d {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:15:02 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:15:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:02 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d 1073741824 Sep 08 19:15:02 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:03 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d 1073741824" returned: 0 in 0.592s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:03 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d Sep 08 19:15:03 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:03 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7782cb5c-3500-40af-88e3-e4301c01476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ed3085-9dc4-4a43-85de-5346e1a17775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Volume volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d (ba4f9eba-e4eb-427e-a1df-0d6575fee81d): created successfully Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84ed3085-9dc4-4a43-85de-5346e1a17775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Flow 'volume_create_manager' (3cdd49e0-e873-42ce-a1ab-0b81472f3d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e4359031-995e-4bfb-818e-ed069fd93876 tempest-TaggedAttachmentsTest-384244614 None] Created volume successfully. Sep 08 19:15:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:15:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:14 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:15:14 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:15 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.359s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:15:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 6 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:15:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Flow 'volume_create_manager' (aa80110e-86e1-422b-a28e-e633adc98bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124c3250-ef81-4f7a-978a-485276ef2c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124c3250-ef81-4f7a-978a-485276ef2c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2022569026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b7c6e3-7858-47f7-b501-56b9ef7d15f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808dad46be15448a92fc1d0c39f3506d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:35Z,use_quota=True,user_id='a602f3bdd7344547a820ac83fc9a7ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d89269b-6853-491b-9217-e6dae4f2b78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d89269b-6853-491b-9217-e6dae4f2b78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb014a6-c703-4dd2-890a-a53991e2fc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb014a6-c703-4dd2-890a-a53991e2fc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b7c6e3-7858-47f7-b501-56b9ef7d15f4', 'volume_name': 'volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf51964a-c61d-4441-b5e4-b055a2dffb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf51964a-c61d-4441-b5e4-b055a2dffb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a52876-0ffc-4875-ac42-806b5b9da7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Volume b0b7c6e3-7858-47f7-b501-56b9ef7d15f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4', 'volume_size': 1} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2022569026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b7c6e3-7858-47f7-b501-56b9ef7d15f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='808dad46be15448a92fc1d0c39f3506d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:35Z,use_quota=True,user_id='a602f3bdd7344547a820ac83fc9a7ef2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Creating volume b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:15:35 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:15:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:35 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 1073741824 Sep 08 19:15:35 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:36 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 1073741824" returned: 0 in 1.191s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:36 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 Sep 08 19:15:36 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:37 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" returned: 0 in 0.485s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1a52876-0ffc-4875-ac42-806b5b9da7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002385d3-8187-4746-ade5-babc1bd273a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:37 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Volume volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 (b0b7c6e3-7858-47f7-b501-56b9ef7d15f4): created successfully Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002385d3-8187-4746-ade5-babc1bd273a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Flow 'volume_create_manager' (aa80110e-86e1-422b-a28e-e633adc98bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cac61d84-697b-4dcd-bcc9-70ba29b73a54 tempest-VolumesAdminNegativeTest-496286881 None] Created volume successfully. Sep 08 19:15:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Acquiring lock "cinder-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "cinder-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Acquiring lock "cinder-quobyte-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:15:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "cinder-quobyte-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" acquired by "delete_volume" :: waited 0.043s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:15:39 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp8cy2s49g/privsep.sock'] Sep 08 19:15:39 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp8cy2s49g/privsep.sock Sep 08 19:15:39 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: Sep 08 19:15:40 devstack cinder-volume[87521]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 08 19:15:40 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:40 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Spawned new privsep daemon via rootwrap Sep 08 19:15:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Accepted privsep connection to /tmp/tmp8cy2s49g/privsep.sock {{(pid=87521) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 08 19:15:40 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 08 19:15:40 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 08 19:15:40 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 08 19:15:40 devstack cinder-volume[87521]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88727 Sep 08 19:15:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd9453-db3e-4754-8e3a-fa17775890f9]: (2,) {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4137b4c7-53aa-4783-b391-1bb36c86dce9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:15:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:40 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 Sep 08 19:15:40 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:41 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" returned: 0 in 0.585s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:41 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4 Sep 08 19:15:41 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:41 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" returned: 0 in 0.406s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "cinder-quobyte-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4" released by "delete_volume" :: held 2.441s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:41 devstack cinder-volume[87521]: WARNING cinder.quota [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:15:41 devstack cinder-volume[87521]: WARNING cinder.quota [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:15:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Created reservations ['b6be9c75-6515-40e5-aec8-97d0dec32c9c', 'f095df3d-6605-46f0-812a-bf32c378f5db', '31da94d1-d6cc-47dd-a0bb-eb66ec7904ae', '77369a73-1f06-45a7-acf8-568a6697e8e8'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:42 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:15:42 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:42 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:15:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Deleted volume successfully. Sep 08 19:15:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac8f094d-057c-4ee2-b668-022b2b5c24b5 tempest-VolumesAdminNegativeTest-496286881 None] Lock "cinder-b0b7c6e3-7858-47f7-b501-56b9ef7d15f4-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Flow 'volume_create_manager' (f1cacdc4-0208-4aca-9164-2bafaf69312c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb63416e-60b3-4815-a747-30fd9b393483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb63416e-60b3-4815-a747-30fd9b393483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-154132213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c83408-1d15-436e-9e84-f7ffb6d26a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccc62500b9434981fdaf220b8378e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:51Z,use_quota=True,user_id='34bfc155f8ec41fb8a7817157b85d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6c6aec-ef71-4097-874b-709a93b65b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a6c6aec-ef71-4097-874b-709a93b65b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cce160-e8eb-4235-9f1d-83ca6c6b628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1cce160-e8eb-4235-9f1d-83ca6c6b628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c83408-1d15-436e-9e84-f7ffb6d26a52', 'volume_name': 'volume-71c83408-1d15-436e-9e84-f7ffb6d26a52', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb2551-f6e3-4deb-b117-579a988c08d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6fb2551-f6e3-4deb-b117-579a988c08d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a41ba21-ef41-412d-931c-9d9480125eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Volume 71c83408-1d15-436e-9e84-f7ffb6d26a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c83408-1d15-436e-9e84-f7ffb6d26a52', 'volume_size': 1} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-154132213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c83408-1d15-436e-9e84-f7ffb6d26a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccc62500b9434981fdaf220b8378e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:15:51Z,use_quota=True,user_id='34bfc155f8ec41fb8a7817157b85d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Creating volume 71c83408-1d15-436e-9e84-f7ffb6d26a52 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:15:50 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:15:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:50 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 1073741824 Sep 08 19:15:50 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:51 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 1073741824" returned: 0 in 0.520s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:15:51 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 Sep 08 19:15:51 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:15:51 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52" returned: 0 in 0.293s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a41ba21-ef41-412d-931c-9d9480125eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c83408-1d15-436e-9e84-f7ffb6d26a52', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acb576-962b-4358-bdd9-86e426dfb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:15:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Volume volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 (71c83408-1d15-436e-9e84-f7ffb6d26a52): created successfully Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42acb576-962b-4358-bdd9-86e426dfb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:15:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Flow 'volume_create_manager' (f1cacdc4-0208-4aca-9164-2bafaf69312c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:15:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7888250a-20da-440c-a1a9-8b3b40f22a43 tempest-ServerActionsTestOtherA-1660973986 None] Created volume successfully. Sep 08 19:16:01 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=15,cinder:SELECT=8,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:01 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:15 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:16:15 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:15 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.453s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:16:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 8 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:16:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:16:23 devstack cinder-volume[87521]: WARNING py.warnings [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 08 19:16:23 devstack cinder-volume[87521]: .first() Sep 08 19:16:23 devstack cinder-volume[87521]: Sep 08 19:16:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2754ad0b-c113-4675-b8cf-187e1caf2b22', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:16:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-e942bf85-d6f9-4487-8c93-a08a35acc8e7 req-8acec86c-74dc-4845-b22e-14e4d84bc4a7 tempest-TaggedAttachmentsTest-384244614 None] attachment_update completed successfully. Sep 08 19:16:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-65546a47-699b-4dc0-bed7-64d6f42696bb req-07df40fa-9d41-4de1-8ca3-da62f338da81 tempest-TaggedAttachmentsTest-384244614 None] Terminate volume connection completed successfully. Sep 08 19:16:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-65546a47-699b-4dc0-bed7-64d6f42696bb req-07df40fa-9d41-4de1-8ca3-da62f338da81 tempest-TaggedAttachmentsTest-384244614 None] Deleting attachment 2754ad0b-c113-4675-b8cf-187e1caf2b22. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Flow 'volume_create_manager' (85efd579-77f2-4bd4-891e-19d03ae0b177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6582ff99-1261-45d5-8859-0b7276cf308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6582ff99-1261-45d5-8859-0b7276cf308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1649669293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ff8df8-2c96-4e2f-b112-829516c97e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ea5eff79a4669bbf1ed3b68f778c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:35Z,use_quota=True,user_id='d9818c82231f4877a108475586eec00a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2724fe8f-08d9-4956-bac1-8ac38d5d30df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2724fe8f-08d9-4956-bac1-8ac38d5d30df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da7be8-40a1-4f98-b6e7-dc582afb78f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34da7be8-40a1-4f98-b6e7-dc582afb78f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25ff8df8-2c96-4e2f-b112-829516c97e8a', 'volume_name': 'volume-25ff8df8-2c96-4e2f-b112-829516c97e8a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85dc018-1c3e-4533-a68d-b1fbde29ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d85dc018-1c3e-4533-a68d-b1fbde29ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f03edc-4288-4401-a30d-dea734669b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:34 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Volume 25ff8df8-2c96-4e2f-b112-829516c97e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25ff8df8-2c96-4e2f-b112-829516c97e8a', 'volume_size': 1} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1649669293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25ff8df8-2c96-4e2f-b112-829516c97e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ea5eff79a4669bbf1ed3b68f778c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:35Z,use_quota=True,user_id='d9818c82231f4877a108475586eec00a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Creating volume 25ff8df8-2c96-4e2f-b112-829516c97e8a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:34 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:16:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:34 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a 1073741824 Sep 08 19:16:34 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:35 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a 1073741824" returned: 0 in 0.548s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:35 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a Sep 08 19:16:35 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:35 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f03edc-4288-4401-a30d-dea734669b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25ff8df8-2c96-4e2f-b112-829516c97e8a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c7aa6e-737b-460b-9868-eb9cbbc977f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Volume volume-25ff8df8-2c96-4e2f-b112-829516c97e8a (25ff8df8-2c96-4e2f-b112-829516c97e8a): created successfully Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9c7aa6e-737b-460b-9868-eb9cbbc977f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Flow 'volume_create_manager' (85efd579-77f2-4bd4-891e-19d03ae0b177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bee04e19-ea7b-471a-92a9-5ffe4b7069da tempest-AttachVolumeShelveTestJSON-1354561531 None] Created volume successfully. Sep 08 19:16:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-bbc6cb12-489d-4df9-93e5-996f02ed2692 req-7ae4903a-ac09-4498-bc8d-6ab9f92e4e99 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-bbc6cb12-489d-4df9-93e5-996f02ed2692 req-7ae4903a-ac09-4498-bc8d-6ab9f92e4e99 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-bbc6cb12-489d-4df9-93e5-996f02ed2692 req-7ae4903a-ac09-4498-bc8d-6ab9f92e4e99 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-bbc6cb12-489d-4df9-93e5-996f02ed2692 req-7ae4903a-ac09-4498-bc8d-6ab9f92e4e99 tempest-ServerActionsTestOtherA-1660973986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-71c83408-1d15-436e-9e84-f7ffb6d26a52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d8cc11e-63bc-4c33-aecd-9a51a82e7b1a', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:16:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-bbc6cb12-489d-4df9-93e5-996f02ed2692 req-7ae4903a-ac09-4498-bc8d-6ab9f92e4e99 tempest-ServerActionsTestOtherA-1660973986 None] attachment_update completed successfully. Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "cinder-ba4f9eba-e4eb-427e-a1df-0d6575fee81d-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "cinder-ba4f9eba-e4eb-427e-a1df-0d6575fee81d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "cinder-quobyte-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "cinder-quobyte-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" acquired by "delete_volume" :: waited 0.043s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[780b53e0-5718-4584-9a26-a46e6d2854bb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:42 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:16:43 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d Sep 08 19:16:43 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Flow 'volume_create_manager' (0e66ddec-f46b-47c0-851f-3228e0db166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a901b872-2121-4805-90c7-aa0d677b8763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a901b872-2121-4805-90c7-aa0d677b8763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1567335578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacd701b-10f7-4ead-8a09-8e5e594efd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c565baba7643d4b21dc5be06200df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:43Z,use_quota=True,user_id='9bb1addff3af44298ed7297f6bb1e145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfaec8-eb43-48fd-ba8c-5314a245952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbfaec8-eb43-48fd-ba8c-5314a245952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f48bb6b-2916-4640-b64a-3bb595a85083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f48bb6b-2916-4640-b64a-3bb595a85083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eacd701b-10f7-4ead-8a09-8e5e594efd09', 'volume_name': 'volume-eacd701b-10f7-4ead-8a09-8e5e594efd09', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aa056d-d9cc-4da5-bf10-f7eb0f8c2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aa056d-d9cc-4da5-bf10-f7eb0f8c2e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9a6760-84e7-46ab-a2ef-b22b81e3ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Volume eacd701b-10f7-4ead-8a09-8e5e594efd09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eacd701b-10f7-4ead-8a09-8e5e594efd09', 'volume_size': 1} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1567335578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eacd701b-10f7-4ead-8a09-8e5e594efd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4c565baba7643d4b21dc5be06200df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:16:43Z,use_quota=True,user_id='9bb1addff3af44298ed7297f6bb1e145',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Creating volume eacd701b-10f7-4ead-8a09-8e5e594efd09 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:16:43 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:43 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 1073741824 Sep 08 19:16:43 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:43 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" returned: 0 in 0.903s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:43 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d Sep 08 19:16:43 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:44 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 1073741824" returned: 0 in 0.829s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:44 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 Sep 08 19:16:44 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:44 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" returned: 0 in 0.437s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "cinder-quobyte-ba4f9eba-e4eb-427e-a1df-0d6575fee81d" released by "delete_volume" :: held 1.415s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Created reservations ['a79b9e7c-a40c-4bc9-8a81-6b2bf1fa53c7', '2c27c446-4e84-4747-8686-fa605764aa58', 'ae5d367d-9376-4b76-823f-b236c76b94f0', '8e3982fd-613b-4724-aa79-efb66d89c0f1'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:44 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09" returned: 0 in 0.373s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a9a6760-84e7-46ab-a2ef-b22b81e3ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eacd701b-10f7-4ead-8a09-8e5e594efd09', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ae69cc-fbca-4913-8b69-8d7a273dae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Volume volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 (eacd701b-10f7-4ead-8a09-8e5e594efd09): created successfully Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ae69cc-fbca-4913-8b69-8d7a273dae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:16:44 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:16:44 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Flow 'volume_create_manager' (0e66ddec-f46b-47c0-851f-3228e0db166e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:16:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-29bd877a-c809-4e12-bb6e-448dc52dd0f4 tempest-DeleteServersTestJSON-1913426549 None] Created volume successfully. Sep 08 19:16:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-e7251b01-6e1b-46a1-ad46-27996528afda tempest-ServerActionsTestOtherA-1660973986 None] Terminate volume connection completed successfully. Sep 08 19:16:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-e7251b01-6e1b-46a1-ad46-27996528afda tempest-ServerActionsTestOtherA-1660973986 None] Deleting attachment 1d8cc11e-63bc-4c33-aecd-9a51a82e7b1a. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:16:45 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.444s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:45 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Deleted volume successfully. Sep 08 19:16:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-991601dc-80a0-4cb6-aca4-ba5a8f8db2db tempest-TaggedAttachmentsTest-384244614 None] Lock "cinder-ba4f9eba-e4eb-427e-a1df-0d6575fee81d-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-783ea014-550b-4df5-b747-81059b86248b tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-783ea014-550b-4df5-b747-81059b86248b tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-783ea014-550b-4df5-b747-81059b86248b tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-783ea014-550b-4df5-b747-81059b86248b tempest-ServerActionsTestOtherA-1660973986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-71c83408-1d15-436e-9e84-f7ffb6d26a52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e67b88b-dbae-4796-a602-6e1871e22b7f', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:16:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-4035d862-5c05-4fc4-bcdb-3036deda1269 req-783ea014-550b-4df5-b747-81059b86248b tempest-ServerActionsTestOtherA-1660973986 None] attachment_update completed successfully. Sep 08 19:16:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ec26a54f-de5b-46d2-8041-6d9e453c5c99 req-2a121b25-28e7-499c-a911-b494c2d40585 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ec26a54f-de5b-46d2-8041-6d9e453c5c99 req-2a121b25-28e7-499c-a911-b494c2d40585 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ec26a54f-de5b-46d2-8041-6d9e453c5c99 req-2a121b25-28e7-499c-a911-b494c2d40585 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-ec26a54f-de5b-46d2-8041-6d9e453c5c99 req-2a121b25-28e7-499c-a911-b494c2d40585 tempest-DeleteServersTestJSON-1913426549 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-eacd701b-10f7-4ead-8a09-8e5e594efd09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ca8454a-b1eb-44d9-bd42-684b74dc5498', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:16:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-ec26a54f-de5b-46d2-8041-6d9e453c5c99 req-2a121b25-28e7-499c-a911-b494c2d40585 tempest-DeleteServersTestJSON-1913426549 None] attachment_update completed successfully. Sep 08 19:16:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-8721091e-3d6f-46f8-b971-197f23fe7ee9 req-5fa749fc-9437-4618-90d5-e6da9dea1f73 tempest-DeleteServersTestJSON-1913426549 None] Terminate volume connection completed successfully. Sep 08 19:16:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-8721091e-3d6f-46f8-b971-197f23fe7ee9 req-5fa749fc-9437-4618-90d5-e6da9dea1f73 tempest-DeleteServersTestJSON-1913426549 None] Deleting attachment 5ca8454a-b1eb-44d9-bd42-684b74dc5498. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:16:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-2c84d855-ae58-4db4-901f-58682eb1d9ee req-6adfe05e-3765-477b-b770-b7edd3be6a8b tempest-AttachVolumeShelveTestJSON-1354561531 None] No connector for attachment a78c68b9-a080-4706-bd3d-1cf562df0a91; skipping storage backend terminate_connection call. {{(pid=87521) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 08 19:16:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-2c84d855-ae58-4db4-901f-58682eb1d9ee req-6adfe05e-3765-477b-b770-b7edd3be6a8b tempest-AttachVolumeShelveTestJSON-1354561531 None] Deleting attachment a78c68b9-a080-4706-bd3d-1cf562df0a91. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:16:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "cinder-eacd701b-10f7-4ead-8a09-8e5e594efd09-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "cinder-eacd701b-10f7-4ead-8a09-8e5e594efd09-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "cinder-quobyte-eacd701b-10f7-4ead-8a09-8e5e594efd09" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "cinder-quobyte-eacd701b-10f7-4ead-8a09-8e5e594efd09" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[687d2814-7d21-4198-8381-5ab96f337a15]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:57 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 Sep 08 19:16:57 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:57 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09" returned: 0 in 0.492s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:57 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09 Sep 08 19:16:57 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:57 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eacd701b-10f7-4ead-8a09-8e5e594efd09" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "cinder-quobyte-eacd701b-10f7-4ead-8a09-8e5e594efd09" released by "delete_volume" :: held 0.886s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:16:57 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Created reservations ['d2839fb7-ef31-4ce7-acc9-42def0812260', '316682a2-c3fb-4f46-b9e7-6aa3d3455789', '6ff8d5fb-c4f2-438a-a8b0-59657de6ba19', 'ebc65c26-4c9a-4fcd-8afb-2de62ad76e8a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:16:58 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:16:58 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:16:58 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.427s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:16:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Deleted volume successfully. Sep 08 19:16:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8482a412-30b8-4572-b72a-f8ff5cbf25c6 tempest-DeleteServersTestJSON-1913426549 None] Lock "cinder-eacd701b-10f7-4ead-8a09-8e5e594efd09-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:08 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=42,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:17:08 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=46,cinder:UPDATE=27,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:15 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:17:15 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:15 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.539s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-57062f74-2e32-46b5-8f73-e5edb46bcd8a req-13ef426c-81d3-4988-8dd0-4aa155a920d6 tempest-ServerActionsTestOtherA-1660973986 None] Terminate volume connection completed successfully. Sep 08 19:17:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-57062f74-2e32-46b5-8f73-e5edb46bcd8a req-13ef426c-81d3-4988-8dd0-4aa155a920d6 tempest-ServerActionsTestOtherA-1660973986 None] Deleting attachment 5e67b88b-dbae-4796-a602-6e1871e22b7f. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:17:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-98cc7607-23a6-43e4-8349-5c0a4836e985 tempest-GroupsTest-977278608 None] Group tempest-Group1-1710271439: creating Sep 08 19:17:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-98cc7607-23a6-43e4-8349-5c0a4836e985 tempest-GroupsTest-977278608 None] Group tempest-Group1-1710271439: created successfully Sep 08 19:17:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-98cc7607-23a6-43e4-8349-5c0a4836e985 tempest-GroupsTest-977278608 None] Create group completed successfully. Sep 08 19:17:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f67fb4ac-1ff7-4f0a-89e2-decb68a27a0b tempest-GroupsTest-977278608 None] Group tempest-Group2-192261091: creating Sep 08 19:17:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f67fb4ac-1ff7-4f0a-89e2-decb68a27a0b tempest-GroupsTest-977278608 None] Group tempest-Group2-192261091: created successfully Sep 08 19:17:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f67fb4ac-1ff7-4f0a-89e2-decb68a27a0b tempest-GroupsTest-977278608 None] Create group completed successfully. Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (fa844523-5130-40a5-ac19-b0427e24b5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715f9b0-d97b-4691-8f1f-1a39578672a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715f9b0-d97b-4691-8f1f-1a39578672a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330020687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95edcea9-60ab-452b-9796-d69fee05e05d,host='devstack@QuobyteHD#QuobyteHD',id=d6bb7210-2631-45b2-a522-eff739c1419e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:23Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ce75c6-8652-4185-a065-76e9bd2a2cbb),volume_type_id=33ce75c6-8652-4185-a065-76e9bd2a2cbb)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eafe9e6-5103-4d98-8248-b2dcc043f423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eafe9e6-5103-4d98-8248-b2dcc043f423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0a177d-3481-4e86-8dfd-2466c361c486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0a177d-3481-4e86-8dfd-2466c361c486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6bb7210-2631-45b2-a522-eff739c1419e', 'volume_name': 'volume-d6bb7210-2631-45b2-a522-eff739c1419e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f504e91-1a32-4a25-a757-3a649a26e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f504e91-1a32-4a25-a757-3a649a26e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7475abc9-b736-4dff-8a9e-550982c6fcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Volume d6bb7210-2631-45b2-a522-eff739c1419e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6bb7210-2631-45b2-a522-eff739c1419e', 'volume_size': 1} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95edcea9-60ab-452b-9796-d69fee05e05d,created_at=2026-09-08T17:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1330020687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95edcea9-60ab-452b-9796-d69fee05e05d,host='devstack@QuobyteHD#QuobyteHD',id=d6bb7210-2631-45b2-a522-eff739c1419e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:23Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33ce75c6-8652-4185-a065-76e9bd2a2cbb),volume_type_id=33ce75c6-8652-4185-a065-76e9bd2a2cbb)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Creating volume d6bb7210-2631-45b2-a522-eff739c1419e {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:23 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:23 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e 1073741824 Sep 08 19:17:23 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:23 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e 1073741824" returned: 0 in 0.499s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:24 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e Sep 08 19:17:24 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:24 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e" returned: 0 in 0.407s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7475abc9-b736-4dff-8a9e-550982c6fcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bb7210-2631-45b2-a522-eff739c1419e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343afc69-7606-43a4-afe5-1f326784c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Volume volume-d6bb7210-2631-45b2-a522-eff739c1419e (d6bb7210-2631-45b2-a522-eff739c1419e): created successfully Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343afc69-7606-43a4-afe5-1f326784c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (fa844523-5130-40a5-ac19-b0427e24b5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bd7af18e-0bbe-4b0b-a006-0dcca9a26d89 tempest-GroupsTest-977278608 None] Created volume successfully. Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Flow 'volume_create_manager' (ac5c88e5-6f71-4fdc-a5fb-8e415f0f0a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f3e6be-be82-4362-8766-f89081719a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f3e6be-be82-4362-8766-f89081719a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-42777382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0e7a7d-acc7-4bd9-a4ba-cc468665db83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccc62500b9434981fdaf220b8378e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:25Z,use_quota=True,user_id='34bfc155f8ec41fb8a7817157b85d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cd2949-10ec-4b88-b796-1506daf20ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cd2949-10ec-4b88-b796-1506daf20ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bbe207-3667-4896-89b8-11d4e7ace681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:24 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bbe207-3667-4896-89b8-11d4e7ace681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'volume_name': 'volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529aac07-a5a9-4509-8b29-2250e7ab8c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529aac07-a5a9-4509-8b29-2250e7ab8c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aeca73-3435-42fd-bdb6-65262fda1343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:25 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Trying to clone 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 from image 6b778823-fa2d-480a-aa07-bfb706774474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:17:25 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a83c217-862a-4167-b2a8-d6914c92e8f6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:25 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD Sep 08 19:17:25 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:26 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 is fetched for user 34bfc155f8ec41fb8a7817157b85d64c. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[787dd4ef-e67d-4d7e-aca3-9ae20c555465]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:26 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD Sep 08 19:17:26 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:26 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-42777382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0e7a7d-acc7-4bd9-a4ba-cc468665db83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30ccc62500b9434981fdaf220b8378e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:25Z,use_quota=True,user_id='34bfc155f8ec41fb8a7817157b85d64c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Creating volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:26 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:17:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:26 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1073741824 Sep 08 19:17:26 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Acquiring lock "cinder-quobyte-d6bb7210-2631-45b2-a522-eff739c1419e" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-d6bb7210-2631-45b2-a522-eff739c1419e" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc1334-c041-41a1-9288-e1da302e702b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:27 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e Sep 08 19:17:27 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:27 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1073741824" returned: 0 in 0.886s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:27 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 Sep 08 19:17:27 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:27 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e" returned: 0 in 0.684s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:27 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e Sep 08 19:17:27 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:28 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:28 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6bb7210-2631-45b2-a522-eff739c1419e" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Attempting download of 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-d6bb7210-2631-45b2-a522-eff739c1419e" released by "delete_volume" :: held 1.136s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Created reservations ['5ac3843e-3d13-42ae-9796-05d6f32255a4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf9d1ab-8f3d-4c9f-80bd-12f533c7961b]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:28 devstack cinder-volume[87521]: WARNING cinder.quota [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1488791945 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1488791945, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:17:28 devstack cinder-volume[87521]: WARNING cinder.quota [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1488791945 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1488791945, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Created reservations ['ac5e466d-3026-4a82-9f3f-323525557ee1', '1a3efa90-3783-4178-8755-515089e1b563', '5b3cc99a-3a6e-4141-8104-8fc2c81361ab', '1e0150aa-9c9f-4410-8803-e9fcef99b2b9'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:28 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o Sep 08 19:17:28 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:28 devstack sudo[91171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:17:28 devstack sudo[91171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:28 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o" returned: 0 in 0.629s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:29 devstack sudo[91171]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.509s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-59b0dcbe-b156-4cf2-8af6-b1d7662d5ff7 tempest-GroupsTest-977278608 None] Delete group completed successfully. Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Created reservations ['8ec3b99a-5c0a-4100-b295-44ee98f00ea2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:29 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o Sep 08 19:17:29 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:29 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:17:29 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:29 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o" returned: 1 in 0.435s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_4_iaoa1o' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[749f8135-a327-484e-bd0b-ea154f0e1cc2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:29 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.342s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e06fc8d5-e792-461a-84a9-e03abb447a20 tempest-GroupsTest-977278608 None] Delete group completed successfully. Sep 08 19:17:29 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD Sep 08 19:17:29 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:29 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] 6b778823-fa2d-480a-aa07-bfb706774474 was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:17:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:29 devstack sudo[91206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 Sep 08 19:17:29 devstack sudo[91206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3c7acd4-d820-4eb9-81e4-f1681b738645 tempest-GroupsTest-977278608 None] Group tempest-GroupsTest-Group-44024031: creating Sep 08 19:17:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3c7acd4-d820-4eb9-81e4-f1681b738645 tempest-GroupsTest-977278608 None] Group tempest-GroupsTest-Group-44024031: created successfully Sep 08 19:17:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3c7acd4-d820-4eb9-81e4-f1681b738645 tempest-GroupsTest-977278608 None] Create group completed successfully. Sep 08 19:17:33 devstack sudo[91206]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" returned: 0 in 3.795s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:33 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_3rvjzun1devstack@QuobyteHD, size 112.00 MB, duration 3.80 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:17:33 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Converted 112.00 MB image at 29.51 MB/s Sep 08 19:17:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:33 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1G Sep 08 19:17:33 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (d5348f75-5a49-4808-b07e-1068ae165928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269487d7-e00d-41b7-90dd-313004221c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269487d7-e00d-41b7-90dd-313004221c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661003784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96101e03-945f-47cd-9a6a-c62c49912a7b,host='devstack@QuobyteHD#QuobyteHD',id=84dad974-4ce5-4ec2-9d5a-c46bf0653f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:34Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d35b5d1-476d-423c-8a85-289dca8ae5e9),volume_type_id=1d35b5d1-476d-423c-8a85-289dca8ae5e9)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1451b51-16b7-4e61-8920-5ea807e4de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1451b51-16b7-4e61-8920-5ea807e4de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8594d2-0db3-44e1-9f03-49d26243d9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:34 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8594d2-0db3-44e1-9f03-49d26243d9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dad974-4ce5-4ec2-9d5a-c46bf0653f7b', 'volume_name': 'volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92f3536-0d45-4bd2-b789-13bc2b3f34e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92f3536-0d45-4bd2-b789-13bc2b3f34e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158810f-460e-42ca-943d-e059227259b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:34 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Volume 84dad974-4ce5-4ec2-9d5a-c46bf0653f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b', 'volume_size': 1} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96101e03-945f-47cd-9a6a-c62c49912a7b,created_at=2026-09-08T17:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-661003784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96101e03-945f-47cd-9a6a-c62c49912a7b,host='devstack@QuobyteHD#QuobyteHD',id=84dad974-4ce5-4ec2-9d5a-c46bf0653f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:34Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d35b5d1-476d-423c-8a85-289dca8ae5e9),volume_type_id=1d35b5d1-476d-423c-8a85-289dca8ae5e9)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Creating volume 84dad974-4ce5-4ec2-9d5a-c46bf0653f7b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:34 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 1G" returned: 0 in 1.041s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Downloaded image 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 for user 34bfc155f8ec41fb8a7817157b85d64c is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Marking volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:17:34 devstack sudo[91339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b 1073741824 Sep 08 19:17:34 devstack sudo[91339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Copying metadata from image 6b778823-fa2d-480a-aa07-bfb706774474 to 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:17:34 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Creating volume glance metadata for volume 0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 backed by image 6b778823-fa2d-480a-aa07-bfb706774474 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:17:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38aeca73-3435-42fd-bdb6-65262fda1343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73644210-9146-4f4b-8692-f4cbdfd5539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Volume volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 (0b0e7a7d-acc7-4bd9-a4ba-cc468665db83): created successfully Sep 08 19:17:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73644210-9146-4f4b-8692-f4cbdfd5539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Flow 'volume_create_manager' (ac5c88e5-6f71-4fdc-a5fb-8e415f0f0a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-94f04d56-a7b8-4d8e-8ceb-ad847c988ce4 tempest-ServerActionsTestOtherA-1660973986 None] Created volume successfully. Sep 08 19:17:36 devstack sudo[91339]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b 1073741824" returned: 0 in 1.548s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:36 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b Sep 08 19:17:36 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:36 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" returned: 0 in 0.529s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.276s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d158810f-460e-42ca-943d-e059227259b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1c96fd-6cea-401e-9bf9-290c01fcb39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:37 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Volume volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b (84dad974-4ce5-4ec2-9d5a-c46bf0653f7b): created successfully Sep 08 19:17:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1c96fd-6cea-401e-9bf9-290c01fcb39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (d5348f75-5a49-4808-b07e-1068ae165928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-771b8b6f-ecc6-45e4-89ac-a8eb102cb09a tempest-GroupsTest-977278608 None] Created volume successfully. Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (3d2aef86-58ea-49be-873c-24b18814f248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c21354f-838a-48f3-8430-80556746f856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c21354f-838a-48f3-8430-80556746f856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3304169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96101e03-945f-47cd-9a6a-c62c49912a7b,host='devstack@QuobyteHD#QuobyteHD',id=637de50e-f109-412f-9b25-58bc6dd6200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:39Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d35b5d1-476d-423c-8a85-289dca8ae5e9),volume_type_id=1d35b5d1-476d-423c-8a85-289dca8ae5e9)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a62a51c-8382-4075-8666-844ffec06ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a62a51c-8382-4075-8666-844ffec06ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617daf0-9513-4a07-bf72-792267a66ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617daf0-9513-4a07-bf72-792267a66ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637de50e-f109-412f-9b25-58bc6dd6200c', 'volume_name': 'volume-637de50e-f109-412f-9b25-58bc6dd6200c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ebd49d-8204-42e4-b273-3c39dc629662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ebd49d-8204-42e4-b273-3c39dc629662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95420ba-c2c7-4be1-96de-94fed95b4aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:39 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Volume 637de50e-f109-412f-9b25-58bc6dd6200c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637de50e-f109-412f-9b25-58bc6dd6200c', 'volume_size': 1} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=96101e03-945f-47cd-9a6a-c62c49912a7b,created_at=2026-09-08T17:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-3304169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=96101e03-945f-47cd-9a6a-c62c49912a7b,host='devstack@QuobyteHD#QuobyteHD',id=637de50e-f109-412f-9b25-58bc6dd6200c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcddb0284545a2a965190b020693f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:39Z,use_quota=True,user_id='1096ec10f2854af9a1b374527e279b2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d35b5d1-476d-423c-8a85-289dca8ae5e9),volume_type_id=1d35b5d1-476d-423c-8a85-289dca8ae5e9)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Creating volume 637de50e-f109-412f-9b25-58bc6dd6200c {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:39 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:17:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:39 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c 1073741824 Sep 08 19:17:39 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:41 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c 1073741824" returned: 0 in 2.040s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:41 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c Sep 08 19:17:41 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:42 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c" returned: 0 in 0.808s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] <== create_volume: return (2960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.963s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95420ba-c2c7-4be1-96de-94fed95b4aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637de50e-f109-412f-9b25-58bc6dd6200c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605a67ae-8476-4be6-a4b5-aa5bb8ec06c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:42 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Volume volume-637de50e-f109-412f-9b25-58bc6dd6200c (637de50e-f109-412f-9b25-58bc6dd6200c): created successfully Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605a67ae-8476-4be6-a4b5-aa5bb8ec06c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Flow 'volume_create_manager' (3d2aef86-58ea-49be-873c-24b18814f248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a67cd9a2-f13d-4d6b-8031-dc4cfc5f137b tempest-GroupsTest-977278608 None] Created volume successfully. Sep 08 19:17:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a84d3fa7-91bf-473a-ba60-313c0e248ccd req-35fdf073-2590-4caf-9d2b-4efaff7acfb7 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a84d3fa7-91bf-473a-ba60-313c0e248ccd req-35fdf073-2590-4caf-9d2b-4efaff7acfb7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a84d3fa7-91bf-473a-ba60-313c0e248ccd req-35fdf073-2590-4caf-9d2b-4efaff7acfb7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-a84d3fa7-91bf-473a-ba60-313c0e248ccd req-35fdf073-2590-4caf-9d2b-4efaff7acfb7 tempest-ServerActionsTestOtherA-1660973986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed864907-9f40-48e2-8040-08f1f51854ff', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:17:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-a84d3fa7-91bf-473a-ba60-313c0e248ccd req-35fdf073-2590-4caf-9d2b-4efaff7acfb7 tempest-ServerActionsTestOtherA-1660973986 None] attachment_update completed successfully. Sep 08 19:17:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-eceafdb4-8a4a-4ef8-b0f9-c5d38b3eb15a tempest-GroupsTest-977278608 None] Update group completed successfully. Sep 08 19:17:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3f5f59f4-c55e-44ec-97bc-ed6117deff3e tempest-GroupsTest-977278608 None] Update group completed successfully. Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Acquiring lock "cinder-25ff8df8-2c96-4e2f-b112-829516c97e8a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "cinder-25ff8df8-2c96-4e2f-b112-829516c97e8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Acquiring lock "cinder-quobyte-25ff8df8-2c96-4e2f-b112-829516c97e8a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "cinder-quobyte-25ff8df8-2c96-4e2f-b112-829516c97e8a" acquired by "delete_volume" :: waited 0.046s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b983329f-9ca9-42f3-8b2a-4c59ab379d4f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:47 devstack sudo[91460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a Sep 08 19:17:47 devstack sudo[91460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:47 devstack sudo[91460]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a" returned: 0 in 0.527s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:47 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a Sep 08 19:17:47 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:48 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25ff8df8-2c96-4e2f-b112-829516c97e8a" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "cinder-quobyte-25ff8df8-2c96-4e2f-b112-829516c97e8a" released by "delete_volume" :: held 0.967s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Acquiring lock "cinder-quobyte-637de50e-f109-412f-9b25-58bc6dd6200c" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-637de50e-f109-412f-9b25-58bc6dd6200c" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7c645-2769-48a7-a91e-950d77c7bb38]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Created reservations ['c3a98246-79d2-4324-b765-8ea528f41bcf', '00c88d71-28b1-4ce5-b88c-151816a86e87', '7de22f84-b0a4-44c7-bd5e-d2b7c0418ab1', '46657692-b155-4da2-880f-dc30ea995874'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:48 devstack sudo[91470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c Sep 08 19:17:48 devstack sudo[91470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:48 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:17:48 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:49 devstack sudo[91470]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c" returned: 0 in 0.819s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:49 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c Sep 08 19:17:49 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:49 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.891s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Deleted volume successfully. Sep 08 19:17:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4f00385-46d0-4f18-9fbe-31a9041c14ec tempest-AttachVolumeShelveTestJSON-1354561531 None] Lock "cinder-25ff8df8-2c96-4e2f-b112-829516c97e8a-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:49 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-637de50e-f109-412f-9b25-58bc6dd6200c" returned: 0 in 0.762s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-637de50e-f109-412f-9b25-58bc6dd6200c" released by "delete_volume" :: held 1.684s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Acquiring lock "cinder-quobyte-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" acquired by "delete_volume" :: waited 0.048s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdc953e-0499-46ec-9ae8-d43f9916c1e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:17:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:50 devstack sudo[91890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b Sep 08 19:17:50 devstack sudo[91890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:17:51 devstack sudo[91890]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Flow 'volume_create_manager' (3cf8db3c-ebd5-490d-aa26-0b864e8c848d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a09646-8f0a-4bbb-8836-2de3bd500774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" returned: 0 in 0.922s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:51 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b Sep 08 19:17:51 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4a09646-8f0a-4bbb-8836-2de3bd500774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1820843521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a8820e-2453-48a5-a7b9-60260e8785f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43af0c523974299808e5e24b2c0191a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:51Z,use_quota=True,user_id='c48a18b7172a43738c2a45f43e2e962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417f8ffe-7006-4b67-86bb-735d168830df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417f8ffe-7006-4b67-86bb-735d168830df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f56e3fa-0236-40ec-9c83-dc442600c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f56e3fa-0236-40ec-9c83-dc442600c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a8820e-2453-48a5-a7b9-60260e8785f7', 'volume_name': 'volume-b1a8820e-2453-48a5-a7b9-60260e8785f7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d567bec-a639-43a1-bc62-bc03bfd0b04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d567bec-a639-43a1-bc62-bc03bfd0b04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0412dbbc-95bb-4fe3-8bdc-cf6c603f3e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Volume b1a8820e-2453-48a5-a7b9-60260e8785f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a8820e-2453-48a5-a7b9-60260e8785f7', 'volume_size': 1} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1820843521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a8820e-2453-48a5-a7b9-60260e8785f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b43af0c523974299808e5e24b2c0191a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:17:51Z,use_quota=True,user_id='c48a18b7172a43738c2a45f43e2e962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Creating volume b1a8820e-2453-48a5-a7b9-60260e8785f7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:17:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:51 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 1073741824 Sep 08 19:17:51 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:51 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" returned: 0 in 0.319s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "cinder-quobyte-84dad974-4ce5-4ec2-9d5a-c46bf0653f7b" released by "delete_volume" :: held 1.350s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Created reservations ['952ff364-8c6a-4825-ad89-5570fedb5a8f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:51 devstack cinder-volume[87521]: WARNING cinder.quota [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-146049559 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-146049559, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:17:51 devstack cinder-volume[87521]: WARNING cinder.quota [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-146049559 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-146049559, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Created reservations ['94d23701-0aa0-4ec2-934e-18adfbdbd2a9', '536f172d-5a13-4d43-874c-2c01f28b7973', '21a0d763-7ed4-4c3d-82f3-a1f63d6ca600', '76dafaa7-8b20-4656-94e1-d11481289ccf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Created reservations ['b0a91aaa-f676-4153-a866-51eafa531a79', 'b2bd5a03-5911-4e55-8e36-79015dbc200d', 'a8bee6bb-1196-4e0e-a590-c3b8d32e969c', 'c75ce52c-c2e8-4df7-8dda-0748df3a5c04'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:52 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:17:52 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:52 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 1073741824" returned: 0 in 0.998s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:17:52 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 Sep 08 19:17:52 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:17:52 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.634s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:52 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:17:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0171779a-9c2d-4c02-8aba-12847da82eff tempest-GroupsTest-977278608 None] Delete group completed successfully. Sep 08 19:17:53 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7" returned: 0 in 0.890s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0412dbbc-95bb-4fe3-8bdc-cf6c603f3e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a8820e-2453-48a5-a7b9-60260e8785f7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d187d41-14c0-407e-88d3-b75ed679834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:17:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Volume volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 (b1a8820e-2453-48a5-a7b9-60260e8785f7): created successfully Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d187d41-14c0-407e-88d3-b75ed679834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:17:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Flow 'volume_create_manager' (3cf8db3c-ebd5-490d-aa26-0b864e8c848d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:17:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c80d2fc5-0af0-4ccd-8ca5-409de76bb681 tempest-ServerRescueNegativeTestJSON-53785635 None] Created volume successfully. Sep 08 19:18:03 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=60,cinder:UPDATE=62,cinder:INSERT=18,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:03 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=70,cinder:UPDATE=63,cinder:DELETE=4,cinder:INSERT=19 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-0bfccb38-d217-4342-aaf6-2a689fa0c631 tempest-ServerActionsTestOtherA-1660973986 None] Terminate volume connection completed successfully. Sep 08 19:18:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-0bfccb38-d217-4342-aaf6-2a689fa0c631 tempest-ServerActionsTestOtherA-1660973986 None] Deleting attachment ed864907-9f40-48e2-8040-08f1f51854ff. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:18:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8c14b40e-4f5a-43d7-991d-34dc1175abef tempest-GroupsV314Test-1811114020 None] Group tempest-GroupsV314Test-Group-1222245172: creating Sep 08 19:18:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8c14b40e-4f5a-43d7-991d-34dc1175abef tempest-GroupsV314Test-1811114020 None] Group tempest-GroupsV314Test-Group-1222245172: created successfully Sep 08 19:18:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8c14b40e-4f5a-43d7-991d-34dc1175abef tempest-GroupsV314Test-1811114020 None] Create group completed successfully. Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Acquiring lock "cinder-b1a8820e-2453-48a5-a7b9-60260e8785f7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "cinder-b1a8820e-2453-48a5-a7b9-60260e8785f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Acquiring lock "cinder-quobyte-b1a8820e-2453-48a5-a7b9-60260e8785f7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "cinder-quobyte-b1a8820e-2453-48a5-a7b9-60260e8785f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a545e-6ed9-4f6b-973e-1810d008a186]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-978c8b0c-85e7-4705-9586-9b88359553fc tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-978c8b0c-85e7-4705-9586-9b88359553fc tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:13 devstack sudo[92144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 Sep 08 19:18:13 devstack sudo[92144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-978c8b0c-85e7-4705-9586-9b88359553fc tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-978c8b0c-85e7-4705-9586-9b88359553fc tempest-ServerActionsTestOtherA-1660973986 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09419ca7-f638-43ea-8cb0-9e428c826719', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:18:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-d908dfb0-ad92-49e3-8f46-4dc501ac3717 req-978c8b0c-85e7-4705-9586-9b88359553fc tempest-ServerActionsTestOtherA-1660973986 None] attachment_update completed successfully. Sep 08 19:18:14 devstack sudo[92144]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:14 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7 Sep 08 19:18:14 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:18:14 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Flow 'volume_create_manager' (9566e177-3feb-4d77-8dff-20e559b6cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75face4e-dc95-4200-9b98-68c06224d2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b1a8820e-2453-48a5-a7b9-60260e8785f7" returned: 0 in 0.727s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75face4e-dc95-4200-9b98-68c06224d2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467790346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16bdda98-378a-4e4e-9fa7-ba170361c90d,host='devstack@QuobyteHD#QuobyteHD',id=93ede6b9-c685-446a-b7ce-9331598c7a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56571f3cb01141f09bbc12b9e8b1f361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:18:15Z,use_quota=True,user_id='7b5a8e3f213c4ab7b7f757c4c52712ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdc0aed-74f3-44d9-87f0-ca7f63f36e93),volume_type_id=5cdc0aed-74f3-44d9-87f0-ca7f63f36e93)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d37670-0be7-4589-a1fb-d0b8527ade1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d37670-0be7-4589-a1fb-d0b8527ade1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b30f12-15fe-4392-b984-0956af7c982f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b30f12-15fe-4392-b984-0956af7c982f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ede6b9-c685-446a-b7ce-9331598c7a59', 'volume_name': 'volume-93ede6b9-c685-446a-b7ce-9331598c7a59', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89334221-b60c-4392-b98a-2e3e270ac86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89334221-b60c-4392-b98a-2e3e270ac86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f441cc9c-4611-4260-a93c-29876e4b83fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:14 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Volume 93ede6b9-c685-446a-b7ce-9331598c7a59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ede6b9-c685-446a-b7ce-9331598c7a59', 'volume_size': 1} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=16bdda98-378a-4e4e-9fa7-ba170361c90d,created_at=2026-09-08T17:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-467790346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=16bdda98-378a-4e4e-9fa7-ba170361c90d,host='devstack@QuobyteHD#QuobyteHD',id=93ede6b9-c685-446a-b7ce-9331598c7a59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56571f3cb01141f09bbc12b9e8b1f361',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:18:15Z,use_quota=True,user_id='7b5a8e3f213c4ab7b7f757c4c52712ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5cdc0aed-74f3-44d9-87f0-ca7f63f36e93),volume_type_id=5cdc0aed-74f3-44d9-87f0-ca7f63f36e93)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Creating volume 93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:18:14 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:18:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:14 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 1073741824 Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "cinder-quobyte-b1a8820e-2453-48a5-a7b9-60260e8785f7" released by "delete_volume" :: held 1.487s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:14 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:15 devstack sudo[92221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:15 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Created reservations ['9eb84cc2-4f3c-47d7-82d2-ccd32a862cf4', '91394f4e-4596-4a22-b0a0-f1ad16897e05', '47e248a6-1352-4a61-ba8e-f2d69a64f870', '2bd95544-9ace-4333-a805-ee047f4af8dc'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:15 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.487s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 28 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:15 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:15 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:16 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.423s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Deleted volume successfully. Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3626eef1-8a9a-4f36-943f-931e27b45cf0 tempest-ServerRescueNegativeTestJSON-53785635 None] Lock "cinder-b1a8820e-2453-48a5-a7b9-60260e8785f7-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:16 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 1073741824" returned: 0 in 1.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:16 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:16 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:16 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] <== create_volume: return (1892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f441cc9c-4611-4260-a93c-29876e4b83fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ede6b9-c685-446a-b7ce-9331598c7a59', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4c8ff9-63f1-4fa9-ab6e-f76cb217c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Volume volume-93ede6b9-c685-446a-b7ce-9331598c7a59 (93ede6b9-c685-446a-b7ce-9331598c7a59): created successfully Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e4c8ff9-63f1-4fa9-ab6e-f76cb217c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Flow 'volume_create_manager' (9566e177-3feb-4d77-8dff-20e559b6cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:18:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6f2bae9b-241a-4997-aea8-78ccc8d8b2a4 tempest-GroupsV314Test-1811114020 None] Created volume successfully. Sep 08 19:18:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:19 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Cloning volume 93ede6b9-c685-446a-b7ce-9331598c7a59 to volume 8347d852-240e-46fd-80c2-7052a4a8f9cf Sep 08 19:18:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Creating offline snapshot aae8801f-dbff-46b6-bf05-ecfaa90c6917 of volume 93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:18:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6f59b0-4b81-4ab0-a4fc-153554527cdd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:20 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:20 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:20 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.837s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:20 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 1G Sep 08 19:18:20 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:21 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 1G" returned: 0 in 1.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ede6b9-c685-446a-b7ce-9331598c7a59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:21 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ede6b9-c685-446a-b7ce-9331598c7a59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:21 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:22 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93ede6b9-c685-446a-b7ce-9331598c7a59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.567s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:22 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:18:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:22 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:22 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:23 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.565s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:23 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info Sep 08 19:18:23 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:23 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info" returned: 0 in 0.358s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:23 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:18:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:23 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info Sep 08 19:18:23 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:24 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.info" returned: 0 in 0.611s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Acquiring lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] snapshot: aae8801f-dbff-46b6-bf05-ecfaa90c6917, volume: 8347d852-240e-46fd-80c2-7052a4a8f9cf, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8a6b6-9282-4934-8cd3-9c92b215ed6c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:24 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:24 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:24 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.843s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ede6b9-c685-446a-b7ce-9331598c7a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6165719d-432f-41a4-8b1c-bb4e063b8ac8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:25 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:25 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:25 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.540s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:18:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:25 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf Sep 08 19:18:25 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:33 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=12,cinder:SELECT=24,cinder:INSERT=4 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:33 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=20,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:18:34 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf" returned: 0 in 8.958s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:34 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59, size 1024.00 MB, duration 8.96 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:18:34 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Converted 1024.00 MB image at 114.30 MB/s Sep 08 19:18:34 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:18:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:34 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf Sep 08 19:18:34 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:35 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf" returned: 0 in 0.501s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" released by "_copy_volume_from_snapshot" :: held 10.960s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Acquiring lock "cinder-quobyte-aae8801f-dbff-46b6-bf05-ecfaa90c6917" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-aae8801f-dbff-46b6-bf05-ecfaa90c6917" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Deleting offline snapshot aae8801f-dbff-46b6-bf05-ecfaa90c6917 of volume 93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] snapshot_file for this snap is: volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c75f52-57ab-4118-af4a-4599e27a93af]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:35 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:35 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:35 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.628s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93ede6b9-c685-446a-b7ce-9331598c7a59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac7b01-0d1b-46b1-9fba-63dca0183df9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:36 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:36 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:36 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.973s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:36 devstack sudo[92792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:36 devstack sudo[92792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:37 devstack sudo[92792]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.599s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:37 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917 Sep 08 19:18:37 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:37 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59.aae8801f-dbff-46b6-bf05-ecfaa90c6917" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-aae8801f-dbff-46b6-bf05-ecfaa90c6917" released by "_delete_snapshot" :: held 2.761s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.461s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cd445dbd-3d22-4b79-b677-8dbd5f58ed38 tempest-GroupsV314Test-1811114020 None] Create group from source-group-16bdda98-378a-4e4e-9fa7-ba170361c90d completed successfully. Sep 08 19:18:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Acquiring lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110149a-ab89-4c70-a778-8b5644eb65d2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:39 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf Sep 08 19:18:39 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:40 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf" returned: 0 in 0.476s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:40 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf Sep 08 19:18:40 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:40 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8347d852-240e-46fd-80c2-7052a4a8f9cf" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-8347d852-240e-46fd-80c2-7052a4a8f9cf" released by "delete_volume" :: held 0.807s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Created reservations ['c6fda1c2-442d-4c1c-ac55-912fc8006e3c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:40 devstack cinder-volume[87521]: WARNING cinder.quota [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-563383623 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-563383623, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:18:40 devstack cinder-volume[87521]: WARNING cinder.quota [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-563383623 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-563383623, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Created reservations ['b1234ff9-3e53-4cf7-a27a-49d41ae4f0a1', 'f348839c-f9e8-4e42-8020-174ced0a5947', '1ed86559-a044-4696-bf9e-7fb316640c3a', 'd2acc026-63d6-43d2-b509-0060077c4a76'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:40 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:40 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:41 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-89c6f21a-51f6-43f8-9d50-dc43f5e61373 tempest-GroupsV314Test-1811114020 None] Delete group completed successfully. Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Acquiring lock "cinder-quobyte-93ede6b9-c685-446a-b7ce-9331598c7a59" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-93ede6b9-c685-446a-b7ce-9331598c7a59" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e22b5-1ec0-4ccd-892d-474984b43fb3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:41 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:41 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:41 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.521s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:41 devstack sudo[92842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59 Sep 08 19:18:41 devstack sudo[92842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:42 devstack sudo[92842]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ede6b9-c685-446a-b7ce-9331598c7a59" returned: 0 in 0.327s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Lock "cinder-quobyte-93ede6b9-c685-446a-b7ce-9331598c7a59" released by "delete_volume" :: held 0.972s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Created reservations ['a73e75ac-23c4-41ba-b2f1-04da5e44b72d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Created reservations ['89f2233d-a5da-4501-9612-9979cac44bc2', 'a95faae6-37b0-4e8e-b87f-dd889869c4d8', 'd80e3474-9c5b-477f-b34b-ab8de4501c69', 'c9504399-2940-4708-a617-40f0fa4a22f0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:42 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:42 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:42 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b5b73d1b-d129-4a21-baf7-bc663f7c745d tempest-GroupsV314Test-1811114020 None] Delete group completed successfully. Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Flow 'volume_create_manager' (6c6f30ab-fd92-43fb-9d3b-382abe06919f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fcec04-0c31-4508-a7c9-4ce97a042e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76fcec04-0c31-4508-a7c9-4ce97a042e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1137107893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8252892a-085a-4421-be43-de0064da66d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9ca1884bff4240b8f8f97c623a9919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:18:44Z,use_quota=True,user_id='f1b209189e684c019e1554b9f478f1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e82202-1461-403d-876b-ec3d3c81d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26e82202-1461-403d-876b-ec3d3c81d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36653b9d-cda7-49e2-b30b-170d4b03b21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36653b9d-cda7-49e2-b30b-170d4b03b21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8252892a-085a-4421-be43-de0064da66d9', 'volume_name': 'volume-8252892a-085a-4421-be43-de0064da66d9', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d3bd5-f74b-4455-acf5-954c8552c958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb9d3bd5-f74b-4455-acf5-954c8552c958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0fd83-3a3b-488e-a3d4-82165b5a7f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Volume 8252892a-085a-4421-be43-de0064da66d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8252892a-085a-4421-be43-de0064da66d9', 'volume_size': 1} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1137107893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8252892a-085a-4421-be43-de0064da66d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9ca1884bff4240b8f8f97c623a9919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:18:44Z,use_quota=True,user_id='f1b209189e684c019e1554b9f478f1d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Creating volume 8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:18:44 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:18:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:44 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 1073741824 Sep 08 19:18:44 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:45 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 1073741824" returned: 0 in 0.996s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:45 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 Sep 08 19:18:45 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:46 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d0fd83-3a3b-488e-a3d4-82165b5a7f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8252892a-085a-4421-be43-de0064da66d9', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a776876c-a14f-4b46-acb4-f8502c0cb5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:18:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Volume volume-8252892a-085a-4421-be43-de0064da66d9 (8252892a-085a-4421-be43-de0064da66d9): created successfully Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a776876c-a14f-4b46-acb4-f8502c0cb5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:18:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Flow 'volume_create_manager' (6c6f30ab-fd92-43fb-9d3b-382abe06919f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:18:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-7cb180bc-2ccb-4c93-9a35-f360428e0387 req-b07d2ee3-a56f-45a9-bc40-9639c0249247 tempest-VolumesSnapshotsTestJSON-1666943920 None] Created volume successfully. Sep 08 19:18:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Creating offline snapshot 3ca2e8ed-f99d-40fb-a69c-e03ac61e074a of volume 8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:18:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f151ce-c85c-469a-a27f-5ca346486237]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:47 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 Sep 08 19:18:47 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:48 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9" returned: 0 in 0.943s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:48 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a 1G Sep 08 19:18:48 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:48 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a 1G" returned: 0 in 0.627s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8252892a-085a-4421-be43-de0064da66d9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:48 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8252892a-085a-4421-be43-de0064da66d9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a Sep 08 19:18:48 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:49 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8252892a-085a-4421-be43-de0064da66d9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" returned: 0 in 0.557s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:49 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a is being set with open permissions: ugo+rw Sep 08 19:18:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:49 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a Sep 08 19:18:49 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:49 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" returned: 0 in 0.545s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:50 devstack sudo[92983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info Sep 08 19:18:50 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:50 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info" returned: 0 in 0.530s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:50 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info is being set with open permissions: ugo+rw Sep 08 19:18:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:50 devstack sudo[92994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info Sep 08 19:18:50 devstack sudo[92994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:51 devstack sudo[92994]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.info" returned: 0 in 0.474s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.886s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-9860c173-bc5a-42f5-adc1-88d50176a27b req-0b2e7483-ff5c-4cc8-83df-167190449d77 tempest-VolumesSnapshotsTestJSON-1666943920 None] Create snapshot completed successfully Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "cinder-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "cinder-quobyte-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Deleting offline snapshot 3ca2e8ed-f99d-40fb-a69c-e03ac61e074a of volume 8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] snapshot_file for this snap is: volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[696b6af3-3eed-4c89-b481-bae0afe46832]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:51 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a Sep 08 19:18:51 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:52 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" returned: 0 in 0.562s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8252892a-085a-4421-be43-de0064da66d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6627b0e9-1dcd-4e56-9a42-16840c68e81f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:52 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 Sep 08 19:18:52 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-b8a3f697-2558-497d-b38f-4af1093aa7f6 tempest-ServerActionsTestOtherA-1660973986 None] Terminate volume connection completed successfully. Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-b8a3f697-2558-497d-b38f-4af1093aa7f6 tempest-ServerActionsTestOtherA-1660973986 None] Deleting attachment 09419ca7-f638-43ea-8cb0-9e428c826719. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:18:52 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9" returned: 0 in 0.586s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:52 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a Sep 08 19:18:52 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "cinder-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "cinder-quobyte-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-quobyte-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24e314c-be46-4727-a0d4-fdc4cbd450cb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:53 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 Sep 08 19:18:53 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:53 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" returned: 0 in 0.587s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:53 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a Sep 08 19:18:53 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:53 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" returned: 0 in 0.598s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:53 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83 Sep 08 19:18:53 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:53 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9.3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" returned: 0 in 0.361s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a" released by "_delete_snapshot" :: held 2.282s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" released by "delete_snapshot" :: held 2.336s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:53 devstack cinder-volume[87521]: WARNING cinder.quota [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.quota [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Created reservations ['c2f6ebe2-96b7-4c89-b96d-a0f9b17bf3d5', 'ec8fe1aa-4223-41ab-807e-7fa442154bd3', '53bd03b4-a872-4130-abfd-7af8d9dfa5ce', 'cfe41d35-6acc-413d-a76d-573297a63301'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Delete snapshot completed successfully. Sep 08 19:18:54 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" returned: 0 in 0.434s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-e0d4232c-f8b7-4130-8fe7-3514a038dc17 req-d6320545-9b47-4462-bd86-053aad15b4ae tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-3ca2e8ed-f99d-40fb-a69c-e03ac61e074a-delete_snapshot" released by "delete_snapshot" :: held 2.642s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-quobyte-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83" released by "delete_volume" :: held 1.108s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.quota [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Created reservations ['91847869-38f3-4889-bf28-c7673e603cf7', '882692b3-e10c-49f1-b2ea-91be6a1214ce', '0f5ae50c-7780-458c-942b-0fc0a4ba0964', 'd7aca1b8-cd53-4d2e-a3bd-f163a2f5107c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "cinder-71c83408-1d15-436e-9e84-f7ffb6d26a52-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-71c83408-1d15-436e-9e84-f7ffb6d26a52-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:54 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:54 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "cinder-quobyte-71c83408-1d15-436e-9e84-f7ffb6d26a52" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-quobyte-71c83408-1d15-436e-9e84-f7ffb6d26a52" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd9660a-7399-4619-948b-b31dbb90814a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:54 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 Sep 08 19:18:54 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:54 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.manager [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Deleted volume successfully. Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-430be1c1-5b76-4c8f-a533-2c27e7f6e601 req-54f98141-3f4f-4707-9dd0-136d3138e62f tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-0b0e7a7d-acc7-4bd9-a4ba-cc468665db83-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "cinder-8252892a-085a-4421-be43-de0064da66d9-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-8252892a-085a-4421-be43-de0064da66d9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:18:55 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52" returned: 0 in 0.635s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8236dc2-c356-4548-bc57-0a6093207542]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:55 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52 Sep 08 19:18:55 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b12fe1d7-e924-4769-aa22-560ab0d44f9e tempest-GroupsV320Test-319535457 None] Group tempest-GroupsV320Test-Group-468548837: creating Sep 08 19:18:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b12fe1d7-e924-4769-aa22-560ab0d44f9e tempest-GroupsV320Test-319535457 None] Group tempest-GroupsV320Test-Group-468548837: created successfully Sep 08 19:18:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b12fe1d7-e924-4769-aa22-560ab0d44f9e tempest-GroupsV320Test-319535457 None] Create group completed successfully. Sep 08 19:18:55 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 Sep 08 19:18:55 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:55 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71c83408-1d15-436e-9e84-f7ffb6d26a52" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-quobyte-71c83408-1d15-436e-9e84-f7ffb6d26a52" released by "delete_volume" :: held 0.981s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Created reservations ['f0d164cc-05f4-47eb-ab67-b5dd1b736905', 'eb75d94d-c908-415c-9018-046345338cb0', '361392a3-6c2f-4b1e-ae47-aa32e3cafbe1', '69783a75-f6a6-4783-a1ba-56786722af5b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:55 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9" returned: 0 in 0.397s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:55 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9 Sep 08 19:18:55 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:55 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:55 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:55 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8252892a-085a-4421-be43-de0064da66d9" returned: 0 in 0.253s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-quobyte-8252892a-085a-4421-be43-de0064da66d9" released by "delete_volume" :: held 0.755s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:55 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Deleted volume successfully. Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-abdb3e95-2ff7-4f9a-abe6-667ee0d9c3a7 tempest-ServerActionsTestOtherA-1660973986 None] Lock "cinder-71c83408-1d15-436e-9e84-f7ffb6d26a52-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.quota [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Created reservations ['c0f703b8-d5db-4cb0-ac8a-08d221ebd0c9', 'cd7a59fc-f1ba-41ad-a0d4-81c78bd30332', 'e1ce0678-8be6-4c24-b591-bb603e253fc5', '8360aeb6-14cd-446d-ba42-ab7101885ba4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:55 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:55 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:56 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.273s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG cinder.manager [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Deleted volume successfully. Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-a2bee64d-7aea-49b5-bd7b-8ad129196e6b req-e67f1be3-5e0e-416a-b125-5c7047eb2338 tempest-VolumesSnapshotsTestJSON-1666943920 None] Lock "cinder-8252892a-085a-4421-be43-de0064da66d9-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Created reservations ['e3b0d42d-f5ef-480f-ad28-580147eca57c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:18:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:18:57 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:18:57 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:18:57 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Sep 08 19:18:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.502s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:18:57 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:18:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-624123bc-dcb0-425d-904a-d4c367446f4b tempest-GroupsV320Test-319535457 None] Delete group completed successfully. Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Flow 'volume_create_manager' (96343097-cc06-49c9-a9ce-aecab2b4785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72617373-9084-4261-819b-5f605a7e5e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72617373-9084-4261-819b-5f605a7e5e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574386345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3263ed3a-da2d-4f7a-9e20-065370f5c593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d4419e685704b2ca7593436c58c5e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:02Z,use_quota=True,user_id='79a7a64919ce4ffca045ed05e9702f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a7e7d3-4f66-4160-b814-850bf853ea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54a7e7d3-4f66-4160-b814-850bf853ea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b917b-a4e0-415e-8ed5-04d92d989b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1b917b-a4e0-415e-8ed5-04d92d989b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3263ed3a-da2d-4f7a-9e20-065370f5c593', 'volume_name': 'volume-3263ed3a-da2d-4f7a-9e20-065370f5c593', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b99f23-4463-4483-a7ca-ad9978229e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b99f23-4463-4483-a7ca-ad9978229e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb64afa4-4c50-4e0d-81b3-04eb1ecdc690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Volume 3263ed3a-da2d-4f7a-9e20-065370f5c593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3263ed3a-da2d-4f7a-9e20-065370f5c593', 'volume_size': 1} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1574386345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3263ed3a-da2d-4f7a-9e20-065370f5c593,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7d4419e685704b2ca7593436c58c5e30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:02Z,use_quota=True,user_id='79a7a64919ce4ffca045ed05e9702f01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Creating volume 3263ed3a-da2d-4f7a-9e20-065370f5c593 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:02 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:02 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 1073741824 Sep 08 19:19:02 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:02 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 1073741824" returned: 0 in 0.508s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:02 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 Sep 08 19:19:02 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:02 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593" returned: 0 in 0.291s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb64afa4-4c50-4e0d-81b3-04eb1ecdc690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3263ed3a-da2d-4f7a-9e20-065370f5c593', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffe6b7c-7654-4037-ba43-4073ef2e8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Volume volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 (3263ed3a-da2d-4f7a-9e20-065370f5c593): created successfully Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fffe6b7c-7654-4037-ba43-4073ef2e8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Flow 'volume_create_manager' (96343097-cc06-49c9-a9ce-aecab2b4785e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-d3ee34fd-9b78-4a16-a8e1-48c7becaa28c req-9ad75032-66f1-4151-a42c-934574df3727 tempest-VolumesGetTestJSON-1185817970 None] Created volume successfully. Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Acquiring lock "cinder-3263ed3a-da2d-4f7a-9e20-065370f5c593-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "cinder-3263ed3a-da2d-4f7a-9e20-065370f5c593-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Acquiring lock "cinder-quobyte-3263ed3a-da2d-4f7a-9e20-065370f5c593" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "cinder-quobyte-3263ed3a-da2d-4f7a-9e20-065370f5c593" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[66576787-06e4-470c-956d-a2582b80dd0b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:03 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 Sep 08 19:19:03 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:04 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:04 devstack sudo[93121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593 Sep 08 19:19:04 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:04 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3263ed3a-da2d-4f7a-9e20-065370f5c593" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "cinder-quobyte-3263ed3a-da2d-4f7a-9e20-065370f5c593" released by "delete_volume" :: held 0.696s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG cinder.quota [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Created reservations ['7543ae3b-4840-4f4c-b156-6e4f3476d9ce', '1aee672c-5694-4500-bf21-0a8123261366', 'd8d5e8ba-a4d6-473f-84f1-e303cf78b68d', '425104f2-df11-44e0-879e-f27911378e2d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:04 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:04 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:05 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.369s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.manager [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Deleted volume successfully. Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-1ba997d8-9658-4a01-8b89-f0937cdd2469 req-95223db9-2a4b-4a9a-a167-d0068a298fe4 tempest-VolumesGetTestJSON-1185817970 None] Lock "cinder-3263ed3a-da2d-4f7a-9e20-065370f5c593-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Flow 'volume_create_manager' (4b6fb4fe-21a2-42c3-ba5f-07f75820cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f29171e-00ca-499a-836f-388d93c8e9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f29171e-00ca-499a-836f-388d93c8e9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-432231068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b9327b-80b3-42d1-b6e6-00d33d1a281f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817d8fce7c6d4f34be50b3287e40dd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:06Z,use_quota=True,user_id='c305cc4ab36340c881232eb005680aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8fddb0-7cc3-4276-8ed1-42e7fa6afdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8fddb0-7cc3-4276-8ed1-42e7fa6afdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db543c5b-b8ef-4a6a-84a2-9d9ba64a026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db543c5b-b8ef-4a6a-84a2-9d9ba64a026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b9327b-80b3-42d1-b6e6-00d33d1a281f', 'volume_name': 'volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15619036-0056-4f93-a760-930bc3db40ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15619036-0056-4f93-a760-930bc3db40ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bf21d8-69a0-4ebe-adaf-7991bd35383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:05 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f', 'volume_size': 1} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-432231068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b9327b-80b3-42d1-b6e6-00d33d1a281f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='817d8fce7c6d4f34be50b3287e40dd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:06Z,use_quota=True,user_id='c305cc4ab36340c881232eb005680aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Creating volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:05 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:05 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f 1073741824 Sep 08 19:19:05 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:06 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f 1073741824" returned: 0 in 0.721s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:06 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f Sep 08 19:19:06 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:06 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f" returned: 0 in 0.358s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bf21d8-69a0-4ebe-adaf-7991bd35383e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29714d3-c25d-4dbd-b591-decfb0ae5f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Volume volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f (93b9327b-80b3-42d1-b6e6-00d33d1a281f): created successfully Sep 08 19:19:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29714d3-c25d-4dbd-b591-decfb0ae5f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Flow 'volume_create_manager' (4b6fb4fe-21a2-42c3-ba5f-07f75820cb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-80dcb3f4-29cd-4b1e-aa48-29405cd2c40f tempest-SnapshotsActionsTest-277812932 None] Created volume successfully. Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Creating offline snapshot e33f7f87-44d0-4f67-b166-cc58a946889e of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[320a92e8-037b-48e2-866f-dd7c6b4c439c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:08 devstack sudo[93149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f Sep 08 19:19:08 devstack sudo[93149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:08 devstack sudo[93149]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f" returned: 0 in 0.431s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:08 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e 1G Sep 08 19:19:08 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:09 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e 1G" returned: 0 in 0.463s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:09 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:09 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:09 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.328s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:09 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e is being set with open permissions: ugo+rw Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:09 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:09 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:09 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:09 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info Sep 08 19:19:09 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:09 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:09 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info is being set with open permissions: ugo+rw Sep 08 19:19:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:10 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info Sep 08 19:19:10 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (34620a6b-48c7-4eb9-bc02-8b547cf42519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e3e6f5-2f98-42a9-8640-9f4a2c86de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e3e6f5-2f98-42a9-8640-9f4a2c86de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1414664941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be07c5-3bc3-4b09-8657-6fe00c62c228,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:10Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e6c9c3-976c-40b2-ab4d-22550226543a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e6c9c3-976c-40b2-ab4d-22550226543a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73368c1a-9bf7-43bd-ac92-eb6eaaf84bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73368c1a-9bf7-43bd-ac92-eb6eaaf84bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27be07c5-3bc3-4b09-8657-6fe00c62c228', 'volume_name': 'volume-27be07c5-3bc3-4b09-8657-6fe00c62c228', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7011ca9-e237-4bde-8412-b7e67eee1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7011ca9-e237-4bde-8412-b7e67eee1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f38802-827c-4b7d-bae8-cf31b1701168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Volume 27be07c5-3bc3-4b09-8657-6fe00c62c228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27be07c5-3bc3-4b09-8657-6fe00c62c228', 'volume_size': 1} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:10 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.info" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.177s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1414664941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be07c5-3bc3-4b09-8657-6fe00c62c228,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:10Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Creating volume 27be07c5-3bc3-4b09-8657-6fe00c62c228 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:10 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:10 devstack sudo[93175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 1073741824 Sep 08 19:19:10 devstack sudo[93175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e6710187-a0e2-4962-b2e7-54c4407283c6 tempest-SnapshotsActionsTest-277812932 None] Create snapshot completed successfully Sep 08 19:19:10 devstack sudo[93175]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 1073741824" returned: 0 in 0.523s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:10 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 Sep 08 19:19:10 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:11 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228" returned: 0 in 0.264s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f38802-827c-4b7d-bae8-cf31b1701168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27be07c5-3bc3-4b09-8657-6fe00c62c228', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21651e20-d641-47d2-a0d9-aeba3315cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Volume volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 (27be07c5-3bc3-4b09-8657-6fe00c62c228): created successfully Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21651e20-d641-47d2-a0d9-aeba3315cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (34620a6b-48c7-4eb9-bc02-8b547cf42519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e02ea7e5-3601-4307-8238-019d054273d9 tempest-VolumesTestJSON-1585099601 None] Created volume successfully. Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (e119b5e6-dd4e-4052-9214-f5ceed54910c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1b2148-c673-46c5-b362-677a34db20b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1b2148-c673-46c5-b362-677a34db20b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1220792740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6612906a-98fa-4ddc-b937-96540bb28eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:11Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cc3e7e-bec5-476a-acb9-47b67bf80bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cc3e7e-bec5-476a-acb9-47b67bf80bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb0602-c43b-4631-9d63-ee5f3b00fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00eb0602-c43b-4631-9d63-ee5f3b00fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6612906a-98fa-4ddc-b937-96540bb28eb8', 'volume_name': 'volume-6612906a-98fa-4ddc-b937-96540bb28eb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd51ae2-808f-4d3c-9106-79046eb588ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd51ae2-808f-4d3c-9106-79046eb588ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b14b5c2-eaa4-48c0-8465-96c7f976c242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Volume 6612906a-98fa-4ddc-b937-96540bb28eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6612906a-98fa-4ddc-b937-96540bb28eb8', 'volume_size': 1} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1220792740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6612906a-98fa-4ddc-b937-96540bb28eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:11Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Creating volume 6612906a-98fa-4ddc-b937-96540bb28eb8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:11 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:11 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 1073741824 Sep 08 19:19:11 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:12 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 1073741824" returned: 0 in 0.520s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:12 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 Sep 08 19:19:12 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:12 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.456s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b14b5c2-eaa4-48c0-8465-96c7f976c242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6612906a-98fa-4ddc-b937-96540bb28eb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a15182d-3d6e-49b8-9664-3e607ff33731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Creating offline snapshot a31c86c8-6854-4c03-93e5-df1a588af384 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:12 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Volume volume-6612906a-98fa-4ddc-b937-96540bb28eb8 (6612906a-98fa-4ddc-b937-96540bb28eb8): created successfully Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a15182d-3d6e-49b8-9664-3e607ff33731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (e119b5e6-dd4e-4052-9214-f5ceed54910c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a4d46-b778-4b49-95f8-506296a070a7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-82de3dd1-9eb2-4966-8896-cbfc0c5d9f01 tempest-AttachVolumeTestJSON-1538188774 None] Created volume successfully. Sep 08 19:19:12 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:12 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (11271feb-a48b-4601-aabe-99ab9ca8145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc57355-c053-44c6-bd1e-7efb7e661458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc57355-c053-44c6-bd1e-7efb7e661458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2066198116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32acbdf-2ca5-4a70-b7ec-7690ee08b12a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:13Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e38a77-a3be-45a6-aeef-68e9381597d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e38a77-a3be-45a6-aeef-68e9381597d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72b0794-a617-4901-aa73-858f212e926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72b0794-a617-4901-aa73-858f212e926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32acbdf-2ca5-4a70-b7ec-7690ee08b12a', 'volume_name': 'volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be141306-7413-4ab4-b9d0-443c2a39a045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be141306-7413-4ab4-b9d0-443c2a39a045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e18ef7-31ca-4e5d-8c74-80640c9e1a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:12 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Volume e32acbdf-2ca5-4a70-b7ec-7690ee08b12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a', 'volume_size': 1} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:12 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:12 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 1G Sep 08 19:19:12 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:13 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 1G" returned: 0 in 0.489s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:13 devstack sudo[93209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 Sep 08 19:19:13 devstack sudo[93209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:13 devstack sudo[93209]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384" returned: 0 in 0.334s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:13 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 is being set with open permissions: ugo+rw Sep 08 19:19:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:13 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 Sep 08 19:19:13 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:14 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.280s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2066198116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32acbdf-2ca5-4a70-b7ec-7690ee08b12a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:13Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Creating volume e32acbdf-2ca5-4a70-b7ec-7690ee08b12a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:14 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:14 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a 1073741824 Sep 08 19:19:14 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-66a8085e-04ee-4b18-8bdc-2c9e373acdfe tempest-SnapshotsActionsTest-277812932 None] Create snapshot completed successfully Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-3f9d53a9-37b8-4411-b343-f12f23aaeffe req-4fe1dd5c-2aa9-4e2e-94fc-4cdfe3a65938 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:14 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a 1073741824" returned: 0 in 0.509s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:14 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a Sep 08 19:19:14 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:15 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:15 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:15 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" returned: 0 in 0.274s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-3f9d53a9-37b8-4411-b343-f12f23aaeffe req-4fe1dd5c-2aa9-4e2e-94fc-4cdfe3a65938 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.608s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e18ef7-31ca-4e5d-8c74-80640c9e1a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8d8d18-1d8b-4d2e-b550-b575b2f96521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-3f9d53a9-37b8-4411-b343-f12f23aaeffe req-4fe1dd5c-2aa9-4e2e-94fc-4cdfe3a65938 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:15 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Volume volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a (e32acbdf-2ca5-4a70-b7ec-7690ee08b12a): created successfully Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8d8d18-1d8b-4d2e-b550-b575b2f96521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (11271feb-a48b-4601-aabe-99ab9ca8145a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ea837905-9a58-436e-b0e4-c22300662797 tempest-VolumesTestJSON-1585099601 None] Created volume successfully. Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-3f9d53a9-37b8-4411-b343-f12f23aaeffe req-4fe1dd5c-2aa9-4e2e-94fc-4cdfe3a65938 tempest-AttachVolumeTestJSON-1538188774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-6612906a-98fa-4ddc-b937-96540bb28eb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '207107fe-b2e9-4c2c-b8c2-a8647ff01c84', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-a31c86c8-6854-4c03-93e5-df1a588af384-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-a31c86c8-6854-4c03-93e5-df1a588af384-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-3f9d53a9-37b8-4411-b343-f12f23aaeffe req-4fe1dd5c-2aa9-4e2e-94fc-4cdfe3a65938 tempest-AttachVolumeTestJSON-1538188774 None] attachment_update completed successfully. Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-a31c86c8-6854-4c03-93e5-df1a588af384" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:15 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.404s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 28 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-a31c86c8-6854-4c03-93e5-df1a588af384" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Deleting offline snapshot a31c86c8-6854-4c03-93e5-df1a588af384 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] snapshot_file for this snap is: volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[330c9e5c-b99d-42a1-94b7-49300ef184e5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:15 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 Sep 08 19:19:15 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:15 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384" returned: 0 in 0.454s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bba2d3-a6f7-42a2-97a1-480bf0a82eaf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:16 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:16 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:16 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.679s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:16 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 Sep 08 19:19:16 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (ab46de27-7c4a-4fa1-b31c-0221d4951003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e57a382-9b73-4269-bfb0-6328cb82e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e57a382-9b73-4269-bfb0-6328cb82e2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-64329354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a433b5-39bb-4869-89d8-cc5028e52868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:17Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debe8401-6e84-42fc-be8e-9ea0ae235694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (debe8401-6e84-42fc-be8e-9ea0ae235694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70506ca-1424-4166-a015-fe15d2fecfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70506ca-1424-4166-a015-fe15d2fecfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a433b5-39bb-4869-89d8-cc5028e52868', 'volume_name': 'volume-96a433b5-39bb-4869-89d8-cc5028e52868', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167f50ec-1926-45ac-9219-d8bbaee8d33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167f50ec-1926-45ac-9219-d8bbaee8d33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6109fa6d-7373-4245-9654-2f6eca00ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Volume 96a433b5-39bb-4869-89d8-cc5028e52868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a433b5-39bb-4869-89d8-cc5028e52868', 'volume_size': 1} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-64329354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a433b5-39bb-4869-89d8-cc5028e52868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc8e2e17d74420b5fd76f2c4214edf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:17Z,use_quota=True,user_id='0e7fa13320074748ae4fb20f3d860ea3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Creating volume 96a433b5-39bb-4869-89d8-cc5028e52868 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:17 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:17 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 1073741824 Sep 08 19:19:17 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:17 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384" returned: 0 in 0.729s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:17 devstack sudo[93655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384 Sep 08 19:19:17 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:17 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 1073741824" returned: 0 in 0.599s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:17 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.a31c86c8-6854-4c03-93e5-df1a588af384" returned: 0 in 0.295s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:17 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 Sep 08 19:19:17 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-a31c86c8-6854-4c03-93e5-df1a588af384" released by "_delete_snapshot" :: held 2.350s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_snapshot" :: held 2.387s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Created reservations ['5f58b0ff-84a2-4aec-b93e-57ca20dc9ffa', '9b3eebe7-075a-4c2c-83ad-61d0320e7d15', '3a0fe467-9e42-49ad-8611-b7fc5bf9713d', '69df2b2a-c329-4167-9cac-e1ab9158b0b4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Delete snapshot completed successfully. Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75de30cf-a2c1-4e5c-ba2f-d11a0a5182c4 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-a31c86c8-6854-4c03-93e5-df1a588af384-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:17 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6109fa6d-7373-4245-9654-2f6eca00ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a433b5-39bb-4869-89d8-cc5028e52868', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ebc850-bc83-4192-a890-d5b832302aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Volume volume-96a433b5-39bb-4869-89d8-cc5028e52868 (96a433b5-39bb-4869-89d8-cc5028e52868): created successfully Sep 08 19:19:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ebc850-bc83-4192-a890-d5b832302aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Flow 'volume_create_manager' (ab46de27-7c4a-4fa1-b31c-0221d4951003) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-21bb4004-d8c5-448f-93a0-041b35c10cc5 tempest-VolumesTestJSON-1585099601 None] Created volume successfully. Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Creating offline snapshot 31008d7b-f60f-4cbd-a52a-5be614a8bd31 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23dae5d-605a-4631-b1b9-3b66ba381464]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:19 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:19 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:19 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.577s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:19 devstack sudo[93669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 1G Sep 08 19:19:19 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-96a433b5-39bb-4869-89d8-cc5028e52868-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-96a433b5-39bb-4869-89d8-cc5028e52868-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-quobyte-96a433b5-39bb-4869-89d8-cc5028e52868" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-96a433b5-39bb-4869-89d8-cc5028e52868" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[240479e2-63c7-4201-926a-7c555d62ff65]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:20 devstack sudo[93674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 Sep 08 19:19:20 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:20 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 1G" returned: 0 in 0.722s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:20 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 Sep 08 19:19:20 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:20 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868" returned: 0 in 0.572s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:20 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31" returned: 0 in 0.403s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:20 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 is being set with open permissions: ugo+rw Sep 08 19:19:20 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868 Sep 08 19:19:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:20 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:20 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 Sep 08 19:19:20 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:21 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96a433b5-39bb-4869-89d8-cc5028e52868" returned: 0 in 0.374s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-96a433b5-39bb-4869-89d8-cc5028e52868" released by "delete_volume" :: held 0.999s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:21 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3aaddbdb-a567-41f5-965b-52bd0d388bc2 tempest-SnapshotsActionsTest-277812932 None] Create snapshot completed successfully Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Created reservations ['8bd8a9eb-4a4c-421a-9363-c103c66dd451', '2bc8f945-a36a-4ca6-9234-86e9c41c565d', 'be796433-fdb2-4e2e-8c7f-37824e96b25e', 'cae5f354-c655-4659-b107-9aaeb4267824'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:21 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:21 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:21 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:21 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Deleted volume successfully. Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-51d4684c-e891-4592-9188-a75b74855b36 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-96a433b5-39bb-4869-89d8-cc5028e52868-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-31008d7b-f60f-4cbd-a52a-5be614a8bd31-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-31008d7b-f60f-4cbd-a52a-5be614a8bd31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-31008d7b-f60f-4cbd-a52a-5be614a8bd31" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-31008d7b-f60f-4cbd-a52a-5be614a8bd31" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Deleting offline snapshot 31008d7b-f60f-4cbd-a52a-5be614a8bd31 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] snapshot_file for this snap is: volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62922de-1ae5-456f-bcd9-c00972fa9b15]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:22 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 Sep 08 19:19:22 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-quobyte-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f114c3c7-0b1d-4508-ab50-74b3e68089c6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:23 devstack sudo[93819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a Sep 08 19:19:23 devstack sudo[93819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:23 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31" returned: 0 in 0.855s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad8a01f-5397-4be9-a0cd-1b46df102c50]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:23 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:23 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:23 devstack sudo[93819]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" returned: 0 in 0.818s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:23 devstack sudo[94193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a Sep 08 19:19:23 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:24 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" returned: 0 in 0.569s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a" released by "delete_volume" :: held 1.460s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:24 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.844s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:24 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 Sep 08 19:19:24 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Created reservations ['62fba401-8f37-4d6b-b9e6-cae6c5a9529a', '06b801f9-80d0-4261-b91d-0bfaa7364260', '87e3cc94-d551-4d92-bb0b-1aa8acbe7c6c', 'e1897101-c836-4b9f-ad66-86497dd10737'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:24 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:24 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:24 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.327s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Deleted volume successfully. Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-131de5db-2983-4be1-97bf-aa3c970621f0 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-e32acbdf-2ca5-4a70-b7ec-7690ee08b12a-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:24 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31" returned: 0 in 0.591s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:24 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31 Sep 08 19:19:24 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-27be07c5-3bc3-4b09-8657-6fe00c62c228-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-27be07c5-3bc3-4b09-8657-6fe00c62c228-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "cinder-quobyte-27be07c5-3bc3-4b09-8657-6fe00c62c228" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-27be07c5-3bc3-4b09-8657-6fe00c62c228" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668bf3d-d3f0-478b-ae42-3b0697da2897]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:25 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 Sep 08 19:19:25 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:25 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.31008d7b-f60f-4cbd-a52a-5be614a8bd31" returned: 0 in 0.555s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-31008d7b-f60f-4cbd-a52a-5be614a8bd31" released by "_delete_snapshot" :: held 3.104s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_snapshot" :: held 3.147s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Created reservations ['96790deb-c442-4e10-a59d-b13f41db97a3', 'c582020d-6121-4571-a573-dea5269c83b4', '355bfc85-2341-419f-8654-be877831169b', '59eb7e0a-efe4-4937-819f-d2c028a9bdcf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Delete snapshot completed successfully. Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-83ea3bd7-edc1-462f-9203-dc0046f882f3 tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-31008d7b-f60f-4cbd-a52a-5be614a8bd31-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:25 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228" returned: 0 in 0.725s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:26 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228 Sep 08 19:19:26 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:26 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-27be07c5-3bc3-4b09-8657-6fe00c62c228" returned: 0 in 0.411s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-quobyte-27be07c5-3bc3-4b09-8657-6fe00c62c228" released by "delete_volume" :: held 1.251s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Created reservations ['0a5b12ff-b065-4f39-b20c-a4811fb96b2b', '47a2b767-5cbb-49da-a3cb-cf928a5b8296', '95cd1b42-dcd0-4427-9261-f14da3296cee', '512b6955-af8e-4b2e-a173-bb67df067419'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:26 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:26 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:27 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.408s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Deleted volume successfully. Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-03174655-7950-42f0-bcf7-14a467a61048 tempest-VolumesTestJSON-1585099601 None] Lock "cinder-27be07c5-3bc3-4b09-8657-6fe00c62c228-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Creating offline snapshot 6a56b900-c07b-4fe4-8eb0-aff06ac23f98 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a7b773-4790-43ed-bc23-a9a244c500d9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:27 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:27 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:27 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.511s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:27 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 1G Sep 08 19:19:27 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:28 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 1G" returned: 0 in 0.665s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:28 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 Sep 08 19:19:28 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:29 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98" returned: 0 in 0.595s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:29 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 is being set with open permissions: ugo+rw Sep 08 19:19:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:29 devstack sudo[94290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 Sep 08 19:19:29 devstack sudo[94290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:29 devstack sudo[94290]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98" returned: 0 in 0.610s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-439ecfc6-1e8b-4f44-bec3-bb6f67b51279 tempest-SnapshotsActionsTest-277812932 None] Create snapshot completed successfully Sep 08 19:19:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-6a56b900-c07b-4fe4-8eb0-aff06ac23f98-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-6a56b900-c07b-4fe4-8eb0-aff06ac23f98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-6a56b900-c07b-4fe4-8eb0-aff06ac23f98" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-6a56b900-c07b-4fe4-8eb0-aff06ac23f98" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Deleting offline snapshot 6a56b900-c07b-4fe4-8eb0-aff06ac23f98 of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] snapshot_file for this snap is: volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[977a8649-e4aa-4fe8-b487-d9066027d4a6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:31 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 Sep 08 19:19:31 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:31 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98" returned: 0 in 0.819s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbb9242-b66f-45de-a315-b81d24e13ad3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:32 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:32 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:32 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.897s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:32 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 Sep 08 19:19:32 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:33 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98" returned: 0 in 0.660s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:33 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98 Sep 08 19:19:33 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:33 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.6a56b900-c07b-4fe4-8eb0-aff06ac23f98" returned: 0 in 0.373s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-6a56b900-c07b-4fe4-8eb0-aff06ac23f98" released by "_delete_snapshot" :: held 2.936s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_snapshot" :: held 2.974s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=124,cinder:SELECT=109,cinder:INSERT=30,cinder:DELETE=7 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=134,cinder:SELECT=113,cinder:INSERT=30,cinder:DELETE=12 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Created reservations ['b828c098-f8a4-4c7d-9628-7bab35496f6c', '0ca23cd0-08b6-4276-8453-aa19e4bdb138', '1ff4e2f4-d157-476f-90e7-9f292b3a4030', 'f045cc1b-e8fa-4f72-9be0-2209f976d24d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Delete snapshot completed successfully. Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-df533ff0-083b-4785-bbea-13474d59351b tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-6a56b900-c07b-4fe4-8eb0-aff06ac23f98-delete_snapshot" released by "delete_snapshot" :: held 3.277s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Creating offline snapshot e76cdb5a-b715-42aa-9333-a413b07700fa of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd4a639-8e6e-4f31-bb40-309408f29c59]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:35 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:35 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.552s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:35 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa 1G Sep 08 19:19:35 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa 1G" returned: 0 in 0.909s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6873cc50-0478-46e5-9746-ba11de5483c2 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-1694221337: creating Sep 08 19:19:36 devstack sudo[94417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa Sep 08 19:19:36 devstack sudo[94417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6873cc50-0478-46e5-9746-ba11de5483c2 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-1694221337: created successfully Sep 08 19:19:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6873cc50-0478-46e5-9746-ba11de5483c2 tempest-GroupSnapshotsTest-1895388299 None] Create group completed successfully. Sep 08 19:19:36 devstack sudo[94417]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa" returned: 0 in 0.457s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:36 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa is being set with open permissions: ugo+rw Sep 08 19:19:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:36 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa Sep 08 19:19:36 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:37 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e4598c41-c6f1-4b4d-965d-6052aa945180 tempest-SnapshotsActionsTest-277812932 None] Create snapshot completed successfully Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (57061b8f-d471-4a6a-82fb-9080b0bf94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03977082-8150-4e36-863e-30c41451762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-e76cdb5a-b715-42aa-9333-a413b07700fa-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-e76cdb5a-b715-42aa-9333-a413b07700fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03977082-8150-4e36-863e-30c41451762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167090452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b219206-5fa5-48a8-9980-c1067b5c14d0,host='devstack@QuobyteHD#QuobyteHD',id=70e8c867-3897-4a98-9cfd-3d44f6b97fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:38Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6420e5ba-4d14-4d93-ba51-d2ddf7f6d1f2),volume_type_id=6420e5ba-4d14-4d93-ba51-d2ddf7f6d1f2)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0470f84-6e1a-42c1-ad77-77b3152a39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0470f84-6e1a-42c1-ad77-77b3152a39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284ed72f-1559-4c76-8791-99e5a70aa7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284ed72f-1559-4c76-8791-99e5a70aa7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e8c867-3897-4a98-9cfd-3d44f6b97fb2', 'volume_name': 'volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762e273-7b92-4d22-a20b-be850c2f01e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0762e273-7b92-4d22-a20b-be850c2f01e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c49642-8b72-48d0-8665-bccc1e89f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Volume 70e8c867-3897-4a98-9cfd-3d44f6b97fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2', 'volume_size': 1} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b219206-5fa5-48a8-9980-c1067b5c14d0,created_at=2026-09-08T17:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167090452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b219206-5fa5-48a8-9980-c1067b5c14d0,host='devstack@QuobyteHD#QuobyteHD',id=70e8c867-3897-4a98-9cfd-3d44f6b97fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:38Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6420e5ba-4d14-4d93-ba51-d2ddf7f6d1f2),volume_type_id=6420e5ba-4d14-4d93-ba51-d2ddf7f6d1f2)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Creating volume 70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:38 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_snapshot" :: waited 0.145s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:38 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 1073741824 Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Acquiring lock "cinder-quobyte-e76cdb5a-b715-42aa-9333-a413b07700fa" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:38 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-e76cdb5a-b715-42aa-9333-a413b07700fa" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Deleting offline snapshot e76cdb5a-b715-42aa-9333-a413b07700fa of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] snapshot_file for this snap is: volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[612144f7-328e-4da2-b7e0-22f48e237343]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa Sep 08 19:19:39 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 1073741824" returned: 0 in 0.967s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:39 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:19:39 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:39 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa" returned: 0 in 0.978s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3f52b3-6f2e-458c-9948-ad1f5a54fcb2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c49642-8b72-48d0-8665-bccc1e89f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03ba180-93c7-48de-8704-23e9f3a39112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:40 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Volume volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 (70e8c867-3897-4a98-9cfd-3d44f6b97fb2): created successfully Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03ba180-93c7-48de-8704-23e9f3a39112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (57061b8f-d471-4a6a-82fb-9080b0bf94b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8eeeb469-ccc2-45de-820d-60c44c6b6dac tempest-GroupSnapshotsTest-1895388299 None] Created volume successfully. Sep 08 19:19:40 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:40 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.562s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa Sep 08 19:19:40 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:40 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:40 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa Sep 08 19:19:40 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:41 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e76cdb5a-b715-42aa-9333-a413b07700fa" returned: 0 in 0.271s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-e76cdb5a-b715-42aa-9333-a413b07700fa" released by "_delete_snapshot" :: held 2.418s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_snapshot" :: held 2.467s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Created reservations ['5314d990-4da5-484e-8d9b-b22869ac9bd7', '5c0e9cf8-986d-4287-94f4-f379338b7a5f', '358305e9-7904-47a0-bfd0-c3391793556c', 'c006b8ac-11a7-4f73-b081-6e94d2d40ed0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Delete snapshot completed successfully. Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-65acbff6-683e-42d9-81b4-a2ea6ffc966d tempest-SnapshotsActionsTest-485908427 None] Lock "cinder-e76cdb5a-b715-42aa-9333-a413b07700fa-delete_snapshot" released by "delete_snapshot" :: held 2.786s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] GroupSnapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: creating. Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Group snapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: creating. {{(pid=87521) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Creating offline snapshot b39b5adf-25c3-4094-97bd-49ad9e989eaa of volume 70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19fcdb0-e920-4172-a2b0-8452cb2a0392]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:19:42 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.541s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:42 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa 1G Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "cinder-e33f7f87-44d0-4f67-b166-cc58a946889e-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-e33f7f87-44d0-4f67-b166-cc58a946889e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:42 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "cinder-quobyte-e33f7f87-44d0-4f67-b166-cc58a946889e" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-e33f7f87-44d0-4f67-b166-cc58a946889e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Deleting offline snapshot e33f7f87-44d0-4f67-b166-cc58a946889e of volume 93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] snapshot_file for this snap is: volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e257952c-4a85-471f-9a7a-ec6bc13f7012]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:43 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa 1G" returned: 0 in 1.180s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:43 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:19:43 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:43 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.908s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec32b1-e3dd-4026-9be6-b466ea198b53]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f Sep 08 19:19:44 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.677s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:44 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:19:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:19:44 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f" returned: 0 in 0.765s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:44 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:44 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:44 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.573s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info Sep 08 19:19:45 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.628s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e Sep 08 19:19:45 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info" returned: 0 in 0.478s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:45 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info Sep 08 19:19:45 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:45 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f.e33f7f87-44d0-4f67-b166-cc58a946889e" returned: 0 in 0.379s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-e33f7f87-44d0-4f67-b166-cc58a946889e" released by "_delete_snapshot" :: held 2.993s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_snapshot" :: held 3.035s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Created reservations ['07f9cab4-1a16-4a62-b42f-33854d7a7bf3', 'e7a0dd3c-f164-44e6-b5e7-09d7890c33b4', 'b1e9524e-9973-48b4-a87f-75f8f84a9c55', '59b242b4-e22f-4070-a9bc-261d6341ff11'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Delete snapshot completed successfully. Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6409ba91-2afa-459e-9cd0-f287782d6ec1 tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-e33f7f87-44d0-4f67-b166-cc58a946889e-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:45 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.info" returned: 0 in 0.401s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "cinder-93b9327b-80b3-42d1-b6e6-00d33d1a281f-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-93b9327b-80b3-42d1-b6e6-00d33d1a281f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" acquired by "delete_volume" :: waited 0.057s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8fba938d-c2e6-43bd-b7bf-219037020997 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: created successfully Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dc22a-5d4b-49c3-9108-75f0ff9bcd46]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:46 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f Sep 08 19:19:46 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:47 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f" returned: 0 in 0.828s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:47 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f Sep 08 19:19:47 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:47 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93b9327b-80b3-42d1-b6e6-00d33d1a281f" returned: 0 in 0.456s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-quobyte-93b9327b-80b3-42d1-b6e6-00d33d1a281f" released by "delete_volume" :: held 1.478s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa-df599590-c038-450e-9f3c-8f5a58ca13e0" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa-df599590-c038-450e-9f3c-8f5a58ca13e0" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Creating volume df599590-c038-450e-9f3c-8f5a58ca13e0 from snapshot b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] snapshot: b39b5adf-25c3-4094-97bd-49ad9e989eaa, volume: df599590-c038-450e-9f3c-8f5a58ca13e0, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[132d3105-fe67-481d-b6b8-5870fa078651]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Created reservations ['41fe1282-df8b-43f8-a920-9c9621524cbf', 'ceaed996-eb9e-4fd1-9f10-2065a4c357f4', '7ff71d18-60aa-4684-96f6-a9b0a1de5608', '1f351399-cb7e-48b5-b3ea-78a1f8cb8ab0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack sudo[94651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:48 devstack sudo[94651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:48 devstack sudo[94650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:19:48 devstack sudo[94650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:48 devstack sudo[94651]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.287s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:19:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Deleted volume successfully. Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-326e396b-b680-43db-9598-165b6f82cd6d tempest-SnapshotsActionsTest-277812932 None] Lock "cinder-93b9327b-80b3-42d1-b6e6-00d33d1a281f-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:48 devstack sudo[94650]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.592s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35af580-da3e-4a7e-b1ac-02d41f12b031]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:48 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:19:48 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:49 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.519s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:49 devstack sudo[94667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 Sep 08 19:19:49 devstack sudo[94667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-0b2576c9-b640-43c5-8e69-396c2ca27d90 req-931f8384-8ba5-46b9-8203-b3a24e52954e tempest-AttachVolumeTestJSON-1538188774 None] Terminate volume connection completed successfully. Sep 08 19:19:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-0b2576c9-b640-43c5-8e69-396c2ca27d90 req-931f8384-8ba5-46b9-8203-b3a24e52954e tempest-AttachVolumeTestJSON-1538188774 None] Deleting attachment 207107fe-b2e9-4c2c-b8c2-a8647ff01c84. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Flow 'volume_create_manager' (ad83db98-3e51-40c9-a766-8dae654fa3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74920294-f362-4814-b60e-b3c7f6760d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74920294-f362-4814-b60e-b3c7f6760d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1702299043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2299144f-80d9-4d26-9a1a-d759580e7319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4a43facab1485eb9ed303aec10a10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:53Z,use_quota=True,user_id='b6b3de87e42449678c36ca986a335708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09716be2-5ae8-4697-b299-8df6f0877dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09716be2-5ae8-4697-b299-8df6f0877dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c694971b-1f21-436b-bc05-a52d272224e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c694971b-1f21-436b-bc05-a52d272224e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2299144f-80d9-4d26-9a1a-d759580e7319', 'volume_name': 'volume-2299144f-80d9-4d26-9a1a-d759580e7319', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572e8ab8-126c-4ed4-8202-9b2d2f9de20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (572e8ab8-126c-4ed4-8202-9b2d2f9de20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4589c3-cf35-4f14-8abf-270d537b4892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Volume 2299144f-80d9-4d26-9a1a-d759580e7319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2299144f-80d9-4d26-9a1a-d759580e7319', 'volume_size': 1} Sep 08 19:19:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:55 devstack sudo[94667]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0" returned: 0 in 6.851s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:19:55 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Converted 1024.00 MB image at 149.44 MB/s Sep 08 19:19:55 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:19:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 Sep 08 19:19:56 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0" returned: 0 in 0.310s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" released by "_copy_volume_from_snapshot" :: held 8.432s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa-df599590-c038-450e-9f3c-8f5a58ca13e0" released by "_create_volume_from_snapshot" :: held 8.605s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.655s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.132s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1702299043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2299144f-80d9-4d26-9a1a-d759580e7319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4a43facab1485eb9ed303aec10a10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:19:53Z,use_quota=True,user_id='b6b3de87e42449678c36ca986a335708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Creating volume 2299144f-80d9-4d26-9a1a-d759580e7319 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:19:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:19:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:56 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 1073741824 Sep 08 19:19:56 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-287c5e31-226d-4e78-b15f-3dcaa1ff9774 tempest-GroupSnapshotsTest-1895388299 None] Create group from source-snapshot-81c589c9-7f03-4a39-a4fb-c67e011bd4d9 completed successfully. Sep 08 19:19:57 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 1073741824" returned: 0 in 0.828s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:57 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 Sep 08 19:19:57 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:19:57 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319" returned: 0 in 0.476s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" acquired by "delete_volume" :: waited 0.049s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac4589c3-cf35-4f14-8abf-270d537b4892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2299144f-80d9-4d26-9a1a-d759580e7319', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68482d60-3ccd-4291-8606-64fd6c46803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd537687-4df7-4770-9340-6917e4021d89]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Volume volume-2299144f-80d9-4d26-9a1a-d759580e7319 (2299144f-80d9-4d26-9a1a-d759580e7319): created successfully Sep 08 19:19:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68482d60-3ccd-4291-8606-64fd6c46803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:19:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Flow 'volume_create_manager' (ad83db98-3e51-40c9-a766-8dae654fa3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:19:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5ada3f69-c3dd-4269-94d2-67085c3c2374 tempest-ServersNegativeTestJSON-1844276728 None] Created volume successfully. Sep 08 19:19:58 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 Sep 08 19:19:58 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:58 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0" returned: 0 in 0.526s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:58 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0 Sep 08 19:19:58 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:59 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-df599590-c038-450e-9f3c-8f5a58ca13e0" returned: 0 in 0.621s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-df599590-c038-450e-9f3c-8f5a58ca13e0" released by "delete_volume" :: held 1.294s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['54f10530-b826-4aac-9468-f7c93cbd4bcc'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:59 devstack cinder-volume[87521]: WARNING cinder.quota [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1792796749 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1792796749, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:19:59 devstack cinder-volume[87521]: WARNING cinder.quota [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1792796749 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1792796749, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['27d811f4-1e3e-40aa-9610-21e1a1a7a74a', 'e6d92a47-a55c-4ec8-8029-89bd9e739d8c', 'dead1c2e-2c6d-441b-b675-656941df1077', '27b9791b-fe58-454f-ae81-c01c2d80b4a3'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:19:59 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:19:59 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:19:59 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.417s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:19:59 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-78361fcb-74a2-430b-91b2-25e0b90adec4 tempest-GroupSnapshotsTest-1895388299 None] Delete group completed successfully. Sep 08 19:20:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: deleting Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: deleting {{(pid=87521) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Deleting offline snapshot b39b5adf-25c3-4094-97bd-49ad9e989eaa of volume 70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] snapshot_file for this snap is: volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e4cd35-fdba-467a-991f-d6ccd1b9a95a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Flow 'volume_create_manager' (849eed05-fcd8-4a48-8760-295a449113c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a987f484-2942-41e0-b23a-69bc4749fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a987f484-2942-41e0-b23a-69bc4749fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-246706682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ea6268-7173-4981-aedb-587767d441a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4a43facab1485eb9ed303aec10a10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:01Z,use_quota=True,user_id='b6b3de87e42449678c36ca986a335708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f168c7-0fcf-4d33-a3c9-9b1d80d0a8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f168c7-0fcf-4d33-a3c9-9b1d80d0a8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405a48f3-80d5-4f75-b453-c6c3a2569e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405a48f3-80d5-4f75-b453-c6c3a2569e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ea6268-7173-4981-aedb-587767d441a8', 'volume_name': 'volume-35ea6268-7173-4981-aedb-587767d441a8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44bd400-7d15-4e7a-a61e-59bf5c678209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f44bd400-7d15-4e7a-a61e-59bf5c678209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f8642e-34d1-47b2-806c-1c6b2643269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:01 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Volume 35ea6268-7173-4981-aedb-587767d441a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ea6268-7173-4981-aedb-587767d441a8', 'volume_size': 1} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:01 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-246706682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ea6268-7173-4981-aedb-587767d441a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4a43facab1485eb9ed303aec10a10b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:01Z,use_quota=True,user_id='b6b3de87e42449678c36ca986a335708',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Creating volume 35ea6268-7173-4981-aedb-587767d441a8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:01 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:01 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 1073741824 Sep 08 19:20:01 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a48dba8-4953-4fbb-b2b5-232b686d2635]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:20:01 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:01 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 1073741824" returned: 0 in 0.687s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:01 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 Sep 08 19:20:01 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8" returned: 0 in 0.301s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60f8642e-34d1-47b2-806c-1c6b2643269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ea6268-7173-4981-aedb-587767d441a8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a40a016-e4fe-4145-99fd-a63faf3a7055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Volume volume-35ea6268-7173-4981-aedb-587767d441a8 (35ea6268-7173-4981-aedb-587767d441a8): created successfully Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a40a016-e4fe-4145-99fd-a63faf3a7055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Flow 'volume_create_manager' (849eed05-fcd8-4a48-8760-295a449113c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2de1e7b5-cc55-42c6-8af9-54ff9f88abf8 tempest-ServersNegativeTestJSON-1844276728 None] Created volume successfully. Sep 08 19:20:02 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.746s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:20:02 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:02 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa Sep 08 19:20:02 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:02 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2.b39b5adf-25c3-4094-97bd-49ad9e989eaa" returned: 0 in 0.302s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-b39b5adf-25c3-4094-97bd-49ad9e989eaa" released by "_delete_snapshot" :: held 2.058s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" released by "delete_snapshot" :: held 2.097s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:03 devstack cinder-volume[87521]: WARNING cinder.quota [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1792796749 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1792796749, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['a1bcb87b-a153-41aa-acee-17bd5bab186c', 'b11a2511-9559-4c21-b8d6-3212b9e2f67a', '3a205a30-544f-40e6-8097-bb36ee0f0bfe', '69b1ef84-e059-4d4e-bfb6-0c41fd9043cc'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8fc8e355-ff41-49c2-b5a2-e5d326733d31 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 81c589c9-7f03-4a39-a4fb-c67e011bd4d9: deleted successfully Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "cinder-35ea6268-7173-4981-aedb-587767d441a8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-35ea6268-7173-4981-aedb-587767d441a8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "cinder-quobyte-35ea6268-7173-4981-aedb-587767d441a8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-quobyte-35ea6268-7173-4981-aedb-587767d441a8" acquired by "delete_volume" :: waited 0.045s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" acquired by "delete_volume" :: waited 0.086s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c1025d-e64a-4336-879b-c2fd91ce508e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e1dcb4-7d43-4b49-98bd-bddb867cf93e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:20:04 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack sudo[94855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 Sep 08 19:20:04 devstack sudo[94855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.462s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2 Sep 08 19:20:04 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack sudo[94855]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8" returned: 0 in 0.541s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:04 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8 Sep 08 19:20:04 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:04 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" returned: 0 in 0.306s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-70e8c867-3897-4a98-9cfd-3d44f6b97fb2" released by "delete_volume" :: held 0.863s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:04 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-35ea6268-7173-4981-aedb-587767d441a8" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-quobyte-35ea6268-7173-4981-aedb-587767d441a8" released by "delete_volume" :: held 0.945s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Created reservations ['0250874b-3d64-4e55-8b94-2025134eddae', '27520d22-59c3-4dd8-acc0-11493a09d92b', '9195a60e-977d-400c-8bed-b240308529dc', '8eef44ea-4cd3-4a13-8d26-436e9810ee5d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['df4d44cc-1fb6-439f-8fd1-a1de93a9fee8'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack cinder-volume[87521]: WARNING cinder.db.api [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1792796749'] Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['47b30c04-27ef-474c-a951-498eef3db060', '14aaa3f2-e741-465c-b9d3-c7cdee4dcafb', 'b6a04a59-66f9-4b4c-960c-36f94b2e3d3d', '763acbbf-2ff1-4091-bd6a-04c8e569b518'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:05 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:05 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:05 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:05 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:05 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.459s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Deleted volume successfully. Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d418f6f-d03b-4dc1-8117-baa7e1beda3f tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-35ea6268-7173-4981-aedb-587767d441a8-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:05 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.322s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c45d25f3-738e-45ef-9dc2-7dffa9f5ce74 tempest-GroupSnapshotsTest-1895388299 None] Delete group completed successfully. Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "cinder-2299144f-80d9-4d26-9a1a-d759580e7319-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-2299144f-80d9-4d26-9a1a-d759580e7319-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "cinder-quobyte-2299144f-80d9-4d26-9a1a-d759580e7319" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-quobyte-2299144f-80d9-4d26-9a1a-d759580e7319" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbac2bb-a87b-4f26-ba39-b1c53d4fd831]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:06 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 Sep 08 19:20:06 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:06 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319" returned: 0 in 0.583s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:06 devstack sudo[94899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319 Sep 08 19:20:06 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-43b28edd-1b3f-4d03-a890-6497852c9f01 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-377409270: creating Sep 08 19:20:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-43b28edd-1b3f-4d03-a890-6497852c9f01 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-377409270: created successfully Sep 08 19:20:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-43b28edd-1b3f-4d03-a890-6497852c9f01 tempest-GroupSnapshotsTest-1895388299 None] Create group completed successfully. Sep 08 19:20:07 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2299144f-80d9-4d26-9a1a-d759580e7319" returned: 0 in 0.432s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-quobyte-2299144f-80d9-4d26-9a1a-d759580e7319" released by "delete_volume" :: held 1.078s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Created reservations ['d80e5010-fb5a-4eab-a30b-e8a8f7021a5e', '785c9337-9f33-4525-8e7e-196783334fc3', '8d952d4c-8e49-4c46-91c1-b1f9bfafe028', '07dc4b21-b11b-46d0-b2a3-c790a4f78665'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:07 devstack sudo[94903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:07 devstack sudo[94903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:07 devstack sudo[94903]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Deleted volume successfully. Sep 08 19:20:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f578abb0-43ec-46f8-a25f-4e78007fcf8b tempest-ServersNegativeTestJSON-1844276728 None] Lock "cinder-2299144f-80d9-4d26-9a1a-d759580e7319-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (4247f277-9f1c-464f-9a63-4dd3761cef88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6d38aa-49f5-4267-8d2e-eb4306d9fe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6d38aa-49f5-4267-8d2e-eb4306d9fe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848579680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e0b63-9224-45bc-b482-9cef929a76a2,host='devstack@QuobyteHD#QuobyteHD',id=bbf39d9f-95a4-4e9c-a31a-e33c093f2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:09Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7fd22db-2f07-4569-896e-4cc89aa4bd2b),volume_type_id=e7fd22db-2f07-4569-896e-4cc89aa4bd2b)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c305242-f5ab-41e5-be47-013790f6df87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c305242-f5ab-41e5-be47-013790f6df87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fda0602-79df-45ba-8cc0-c8d058e3b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fda0602-79df-45ba-8cc0-c8d058e3b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbf39d9f-95a4-4e9c-a31a-e33c093f2357', 'volume_name': 'volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860ee2f0-c2ce-4211-a32b-6888384e4fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (860ee2f0-c2ce-4211-a32b-6888384e4fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9950ec4d-0112-452b-96b4-b7e6c069cd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:09 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Volume bbf39d9f-95a4-4e9c-a31a-e33c093f2357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357', 'volume_size': 1} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15e0b63-9224-45bc-b482-9cef929a76a2,created_at=2026-09-08T17:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1848579680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e0b63-9224-45bc-b482-9cef929a76a2,host='devstack@QuobyteHD#QuobyteHD',id=bbf39d9f-95a4-4e9c-a31a-e33c093f2357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:09Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7fd22db-2f07-4569-896e-4cc89aa4bd2b),volume_type_id=e7fd22db-2f07-4569-896e-4cc89aa4bd2b)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Creating volume bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:09 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:09 devstack sudo[94917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 1073741824 Sep 08 19:20:09 devstack sudo[94917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Flow 'volume_create_manager' (af3e46b3-2d87-4662-a289-cdcab55b119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ace1b4-04f5-4bd1-b27d-295be9d3d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3ace1b4-04f5-4bd1-b27d-295be9d3d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1834862146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379d635-5eeb-4f78-a5cb-48e366472d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f593654b00e47c0b964a147ddc00b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:10Z,use_quota=True,user_id='4211e2bc39124888b3047b52371b4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0381a33-f008-4a13-8883-fccabc0e795f),volume_type_id=e0381a33-f008-4a13-8883-fccabc0e795f)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd345fc-1602-4fd7-b979-141bdae1fdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd345fc-1602-4fd7-b979-141bdae1fdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbac1cd-a0a3-49b6-b6d5-e9095fa69429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cbac1cd-a0a3-49b6-b6d5-e9095fa69429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a379d635-5eeb-4f78-a5cb-48e366472d39', 'volume_name': 'volume-a379d635-5eeb-4f78-a5cb-48e366472d39', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db88b34d-61d1-4cf7-88a6-d47ba7f3ca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db88b34d-61d1-4cf7-88a6-d47ba7f3ca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4203e76-bdab-4bb5-bd00-30175755b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Volume a379d635-5eeb-4f78-a5cb-48e366472d39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a379d635-5eeb-4f78-a5cb-48e366472d39', 'volume_size': 1} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:10 devstack sudo[94917]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 1073741824" returned: 0 in 0.936s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:10 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 Sep 08 19:20:10 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" returned: 0 in 0.337s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.669s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1834862146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a379d635-5eeb-4f78-a5cb-48e366472d39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f593654b00e47c0b964a147ddc00b42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:10Z,use_quota=True,user_id='4211e2bc39124888b3047b52371b4a16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0381a33-f008-4a13-8883-fccabc0e795f),volume_type_id=e0381a33-f008-4a13-8883-fccabc0e795f)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Creating volume a379d635-5eeb-4f78-a5cb-48e366472d39 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:10 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9950ec4d-0112-452b-96b4-b7e6c069cd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe969f71-6d07-4dda-9b8f-517f37b04bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:10 devstack sudo[94938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 1073741824 Sep 08 19:20:10 devstack sudo[94938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Volume volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 (bbf39d9f-95a4-4e9c-a31a-e33c093f2357): created successfully Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe969f71-6d07-4dda-9b8f-517f37b04bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (4247f277-9f1c-464f-9a63-4dd3761cef88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3d54a0a6-63c1-4a66-aba2-ec74f588d566 tempest-GroupSnapshotsTest-1895388299 None] Created volume successfully. Sep 08 19:20:11 devstack sudo[94938]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 1073741824" returned: 0 in 0.688s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:11 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 Sep 08 19:20:11 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:11 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4203e76-bdab-4bb5-bd00-30175755b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a379d635-5eeb-4f78-a5cb-48e366472d39', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c727472c-c5a2-43b9-a1e7-9ac31e2c24fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Volume volume-a379d635-5eeb-4f78-a5cb-48e366472d39 (a379d635-5eeb-4f78-a5cb-48e366472d39): created successfully Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c727472c-c5a2-43b9-a1e7-9ac31e2c24fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Flow 'volume_create_manager' (af3e46b3-2d87-4662-a289-cdcab55b119f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-de17b773-205e-4ac1-92f9-de2962e45807 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Created volume successfully. Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (07d4d497-42b3-4bd2-a279-1ad57b3955a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d048198e-39ff-4e7e-a3cb-8c201ba3fa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d048198e-39ff-4e7e-a3cb-8c201ba3fa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583972078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e0b63-9224-45bc-b482-9cef929a76a2,host='devstack@QuobyteHD#QuobyteHD',id=883e21e5-e7f9-423a-9978-711a80609bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:12Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7fd22db-2f07-4569-896e-4cc89aa4bd2b),volume_type_id=e7fd22db-2f07-4569-896e-4cc89aa4bd2b)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75727c32-8db0-4979-ad2b-a2dbe8bf4a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75727c32-8db0-4979-ad2b-a2dbe8bf4a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21072b31-0052-41b9-82f7-0dc1503a7c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21072b31-0052-41b9-82f7-0dc1503a7c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883e21e5-e7f9-423a-9978-711a80609bc9', 'volume_name': 'volume-883e21e5-e7f9-423a-9978-711a80609bc9', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddee9fc-6c1b-40b4-b46d-7835cbcf91d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddee9fc-6c1b-40b4-b46d-7835cbcf91d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99d0ca6-0576-4c76-a68e-164fab2bf16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:12 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Volume 883e21e5-e7f9-423a-9978-711a80609bc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883e21e5-e7f9-423a-9978-711a80609bc9', 'volume_size': 1} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15e0b63-9224-45bc-b482-9cef929a76a2,created_at=2026-09-08T17:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-583972078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e0b63-9224-45bc-b482-9cef929a76a2,host='devstack@QuobyteHD#QuobyteHD',id=883e21e5-e7f9-423a-9978-711a80609bc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:12Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e7fd22db-2f07-4569-896e-4cc89aa4bd2b),volume_type_id=e7fd22db-2f07-4569-896e-4cc89aa4bd2b)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Creating volume 883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:12 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:12 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 1073741824 Sep 08 19:20:12 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 1073741824" returned: 0 in 0.606s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 Sep 08 19:20:13 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:13 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:13 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:13 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9" returned: 0 in 0.265s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b99d0ca6-0576-4c76-a68e-164fab2bf16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883e21e5-e7f9-423a-9978-711a80609bc9', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad438439-9334-49aa-ade9-9085472022d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:13 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Volume volume-883e21e5-e7f9-423a-9978-711a80609bc9 (883e21e5-e7f9-423a-9978-711a80609bc9): created successfully Sep 08 19:20:13 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad438439-9334-49aa-ade9-9085472022d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (07d4d497-42b3-4bd2-a279-1ad57b3955a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:13 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0e15228f-fe9c-49ec-a235-b73064a60368 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Retype volume completed successfully. Sep 08 19:20:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-78f50511-be17-42b0-bbc5-48ed58e7a266 tempest-GroupSnapshotsTest-1895388299 None] Created volume successfully. Sep 08 19:20:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2390761a-cbd5-439f-a71c-31aed3cda13d tempest-GroupSnapshotsTest-1895388299 None] Update group completed successfully. Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "cinder-a379d635-5eeb-4f78-a5cb-48e366472d39-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "cinder-a379d635-5eeb-4f78-a5cb-48e366472d39-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "cinder-quobyte-a379d635-5eeb-4f78-a5cb-48e366472d39" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "cinder-quobyte-a379d635-5eeb-4f78-a5cb-48e366472d39" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8b31bd-0781-4c0f-b981-67356610f6fc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 Sep 08 19:20:14 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:14 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39" returned: 0 in 0.422s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:15 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39 Sep 08 19:20:15 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-83fcfeca-63c3-4576-84fa-27cd45489e24 tempest-GroupSnapshotsTest-1895388299 None] Update group completed successfully. Sep 08 19:20:15 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 28 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:20:15 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a379d635-5eeb-4f78-a5cb-48e366472d39" returned: 0 in 0.279s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "cinder-quobyte-a379d635-5eeb-4f78-a5cb-48e366472d39" released by "delete_volume" :: held 0.763s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:15 devstack cinder-volume[87521]: WARNING cinder.quota [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:15 devstack cinder-volume[87521]: WARNING cinder.quota [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Created reservations ['3de8c4cf-c11c-46f4-af85-cd17a697db8f', '9e68eb36-b94a-4a37-904b-d14ce920e4b8', 'e7cf0024-4414-49f1-8ce8-e90176f9ff70', 'cb145e7b-a928-4c71-a1d0-cbe4dfd850bf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:15 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:15 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:15 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Deleted volume successfully. Sep 08 19:20:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c11cebf0-57fc-4151-aad9-ded73e84af43 tempest-VolumeRetypeWithoutMigrationTest-221464282 None] Lock "cinder-a379d635-5eeb-4f78-a5cb-48e366472d39-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0a18f17d-51d4-489e-9047-8070ea8d33a5 tempest-GroupSnapshotsTest-1895388299 None] Update group completed successfully. Sep 08 19:20:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e32bec64-a204-40cb-95ff-ef1887bfeeff tempest-GroupSnapshotsTest-1895388299 None] Update group completed successfully. Sep 08 19:20:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] GroupSnapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: creating. Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Group snapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: creating. {{(pid=87521) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Creating offline snapshot 956b5386-8109-477f-abe1-2ad9b4262f72 of volume bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2218c524-3dcd-4701-a9b8-29afeafac434]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 Sep 08 19:20:19 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:19 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" returned: 0 in 0.473s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:19 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 1G Sep 08 19:20:19 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 1G" returned: 0 in 0.499s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 Sep 08 19:20:20 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:20 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72" returned: 0 in 0.382s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:20 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:20 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 Sep 08 19:20:20 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info Sep 08 19:20:21 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info" returned: 0 in 0.397s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:21 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info Sep 08 19:20:21 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:21 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.info" returned: 0 in 0.323s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Creating offline snapshot ba3de384-63e2-4d35-9486-135c2b7c1531 of volume 883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7b1cae-d2dd-40fa-a06b-f5161f5b0471]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 Sep 08 19:20:22 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:22 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9" returned: 0 in 0.490s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:22 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 1G Sep 08 19:20:22 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:23 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 1G" returned: 0 in 0.611s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883e21e5-e7f9-423a-9978-711a80609bc9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:23 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883e21e5-e7f9-423a-9978-711a80609bc9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 Sep 08 19:20:23 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:23 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-883e21e5-e7f9-423a-9978-711a80609bc9 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531" returned: 0 in 0.340s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:23 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:23 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 Sep 08 19:20:23 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:23 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531" returned: 0 in 0.273s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:23 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info Sep 08 19:20:23 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:24 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:24 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info Sep 08 19:20:24 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:24 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.info" returned: 0 in 0.314s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-682db6f6-b99a-46c0-8e49-1975b5345087 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: created successfully Sep 08 19:20:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: deleting Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: deleting {{(pid=87521) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-956b5386-8109-477f-abe1-2ad9b4262f72" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-956b5386-8109-477f-abe1-2ad9b4262f72" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Deleting offline snapshot 956b5386-8109-477f-abe1-2ad9b4262f72 of volume bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] snapshot_file for this snap is: volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc7779-cda1-426b-adb3-effda7941851]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:25 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 Sep 08 19:20:25 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:25 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72" returned: 0 in 0.508s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e065c2-e17b-4527-891d-8ff9a166238d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:25 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 Sep 08 19:20:25 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:26 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" returned: 0 in 0.556s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:26 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 Sep 08 19:20:26 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:26 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72" returned: 0 in 0.456s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:26 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72 Sep 08 19:20:26 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:26 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357.956b5386-8109-477f-abe1-2ad9b4262f72" returned: 0 in 0.303s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-956b5386-8109-477f-abe1-2ad9b4262f72" released by "_delete_snapshot" :: held 2.004s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" released by "delete_snapshot" :: held 2.043s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-ba3de384-63e2-4d35-9486-135c2b7c1531" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-ba3de384-63e2-4d35-9486-135c2b7c1531" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Deleting offline snapshot ba3de384-63e2-4d35-9486-135c2b7c1531 of volume 883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] snapshot_file for this snap is: volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[38060530-d6e5-4c32-8b7e-241d8d997495]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:27 devstack sudo[95084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 Sep 08 19:20:27 devstack sudo[95084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:27 devstack sudo[95084]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531" returned: 0 in 0.518s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-883e21e5-e7f9-423a-9978-711a80609bc9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3608a9f7-1e83-42df-98f8-2d435835826b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:27 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 Sep 08 19:20:27 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9" returned: 0 in 0.480s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 Sep 08 19:20:28 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Flow 'volume_create_manager' (a9e1fd19-fcc4-47e3-9262-12c45efbb90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ac6b21-4182-4b51-b56f-d89e8dbd859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76ac6b21-4182-4b51-b56f-d89e8dbd859f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-734203624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16eac5-9d08-45c5-8c67-a54a182b03e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31d0fdbf2df4c50a18c05af01939ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:28Z,use_quota=True,user_id='94585ca32d3b412ab35bafbc6990ebb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28845b3b-6464-4edd-9fbd-a79025e971e3),volume_type_id=28845b3b-6464-4edd-9fbd-a79025e971e3)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9205c16-0c36-4c54-a7ef-02806b8a823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9205c16-0c36-4c54-a7ef-02806b8a823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f47684-931f-4035-9b3f-4cb97453b3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f47684-931f-4035-9b3f-4cb97453b3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae16eac5-9d08-45c5-8c67-a54a182b03e8', 'volume_name': 'volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ff2839-2c01-48ee-ae8c-e2e5b157d9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34ff2839-2c01-48ee-ae8c-e2e5b157d9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dabca46-199b-401a-bc6e-5fb98ad82ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:28 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Volume ae16eac5-9d08-45c5-8c67-a54a182b03e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8', 'volume_size': 1} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-734203624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae16eac5-9d08-45c5-8c67-a54a182b03e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31d0fdbf2df4c50a18c05af01939ab6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:28Z,use_quota=True,user_id='94585ca32d3b412ab35bafbc6990ebb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28845b3b-6464-4edd-9fbd-a79025e971e3),volume_type_id=28845b3b-6464-4edd-9fbd-a79025e971e3)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Creating volume ae16eac5-9d08-45c5-8c67-a54a182b03e8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:28 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 1073741824 Sep 08 19:20:28 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531 Sep 08 19:20:28 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9.ba3de384-63e2-4d35-9486-135c2b7c1531" returned: 0 in 0.291s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 1073741824" returned: 0 in 0.522s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-ba3de384-63e2-4d35-9486-135c2b7c1531" released by "_delete_snapshot" :: held 1.852s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" released by "delete_snapshot" :: held 1.901s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:28 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 Sep 08 19:20:28 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:28 devstack cinder-volume[87521]: WARNING cinder.quota [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-252881937 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-252881937, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:28 devstack cinder-volume[87521]: WARNING cinder.quota [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-252881937 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-252881937, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['8dc85f84-2371-4e92-a020-23eac70b5c0f', '85e416f7-a6b2-47a4-b96c-62a084e6f70c', 'bf94a68c-9d32-4372-8666-894ffeb89fb7', '40993d64-7e4b-4db3-a5a7-f9c858b46320'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['71590041-5a5e-4960-b524-bdcc065d7175', '1573e4dd-a0e8-4144-8880-7c9877c0c807', 'a1c3210b-a15f-4cd9-8180-e756c92d3153', '0a3a9ccd-08d2-4965-b766-4ba94f493603'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:29 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8" returned: 0 in 0.330s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dabca46-199b-401a-bc6e-5fb98ad82ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4a25d-e369-4d3e-b845-2bcc05ca93e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:29 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Volume volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 (ae16eac5-9d08-45c5-8c67-a54a182b03e8): created successfully Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a4a25d-e369-4d3e-b845-2bcc05ca93e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Flow 'volume_create_manager' (a9e1fd19-fcc4-47e3-9262-12c45efbb90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a4c9b60b-03d9-4ea1-9e29-e5635ecaf9af tempest-VolumeTypesAccessTest-535969912 None] Created volume successfully. Sep 08 19:20:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0199a1ed-57ce-4cf3-b1da-3d05e1f0fe10 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot 4b3a3398-ced0-4a8f-93b2-825d716a1b8e: deleted successfully Sep 08 19:20:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce67c5f-b003-4042-919a-9e813c984368]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 Sep 08 19:20:30 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Acquiring lock "cinder-ae16eac5-9d08-45c5-8c67-a54a182b03e8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "cinder-ae16eac5-9d08-45c5-8c67-a54a182b03e8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:30 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9" returned: 0 in 0.475s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9 Sep 08 19:20:30 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Acquiring lock "cinder-quobyte-ae16eac5-9d08-45c5-8c67-a54a182b03e8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "cinder-quobyte-ae16eac5-9d08-45c5-8c67-a54a182b03e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba77a94-d29d-468d-977e-409f8fc5db84]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:30 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 Sep 08 19:20:30 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:30 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-883e21e5-e7f9-423a-9978-711a80609bc9" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-883e21e5-e7f9-423a-9978-711a80609bc9" released by "delete_volume" :: held 0.931s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a14d63-51d0-49a3-ba44-1278b3108e78]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8 Sep 08 19:20:31 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:31 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 Sep 08 19:20:31 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:31 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae16eac5-9d08-45c5-8c67-a54a182b03e8" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "cinder-quobyte-ae16eac5-9d08-45c5-8c67-a54a182b03e8" released by "delete_volume" :: held 0.903s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:31 devstack cinder-volume[87521]: WARNING cinder.quota [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-312641472 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-312641472, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:31 devstack cinder-volume[87521]: WARNING cinder.quota [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-312641472 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-312641472, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:31 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" returned: 0 in 0.604s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Created reservations ['d2b73786-d7b6-4ee0-a8f5-a45f96c3479d', '33927aba-f065-44ed-b8c7-bd7dd2cced66', '6a3dcc47-2b29-4e12-b69c-9c87691cdf5b', '655bc7b5-059d-40f5-a205-aa0579695106'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:31 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357 Sep 08 19:20:31 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:31 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:31 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Flow 'volume_create_manager' (d4ce885e-e650-4946-b2c5-ea6f001548d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cb4172-4f58-49e4-ad1f-f9bcb0bdc1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60cb4172-4f58-49e4-ad1f-f9bcb0bdc1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1212929202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367fefdc-2480-42cd-b7a8-1a05680efc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93115fa45a64e2299231b39e6fa3091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:32Z,use_quota=True,user_id='f0ae8920605d451e89e68d37c4b38ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:32 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9320da8-ca44-42a2-886a-a6d2272d0e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9320da8-ca44-42a2-886a-a6d2272d0e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38802a2-f897-4da2-85cc-af3a5224c0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38802a2-f897-4da2-85cc-af3a5224c0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367fefdc-2480-42cd-b7a8-1a05680efc82', 'volume_name': 'volume-367fefdc-2480-42cd-b7a8-1a05680efc82', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1e324a-3853-45c0-8b74-b50c5ca9d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb1e324a-3853-45c0-8b74-b50c5ca9d512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa4c3b0-ff95-4486-b133-d1db179e24ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Volume 367fefdc-2480-42cd-b7a8-1a05680efc82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367fefdc-2480-42cd-b7a8-1a05680efc82', 'volume_size': 1} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1212929202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367fefdc-2480-42cd-b7a8-1a05680efc82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93115fa45a64e2299231b39e6fa3091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:32Z,use_quota=True,user_id='f0ae8920605d451e89e68d37c4b38ec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Creating volume 367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:32 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" returned: 0 in 0.534s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-bbf39d9f-95a4-4e9c-a31a-e33c093f2357" released by "delete_volume" :: held 1.227s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:32 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 1073741824 Sep 08 19:20:32 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:32 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.383s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:32 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Deleted volume successfully. Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf256537-360a-41af-9870-0f7b6d608a41 tempest-VolumeTypesAccessTest-535969912 None] Lock "cinder-ae16eac5-9d08-45c5-8c67-a54a182b03e8-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['42a87a66-44df-45e2-ba0b-e0fa4ec5f4f2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:32 devstack cinder-volume[87521]: WARNING cinder.quota [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-252881937 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-252881937, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['969b9ad8-00cc-41a1-a1d3-ddc7eaef8657', '2d380095-2c63-4d19-a5f7-55aa3aef14b1', '4e7a0a8d-9259-40f0-9fb8-e08b50b5a262', 'cc56f988-1e92-46d2-829b-4fcefd94289c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['aafc97b7-a1fe-4cea-902e-c0782ac1c2f8', 'e6007770-d54e-44d4-9dae-250e4b48cf3f', '3835bae9-8543-4a37-a74e-7c6b5dc0b1ff', 'a669c2c2-ecd7-4036-9a8d-8fb2fe392639'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:32 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:32 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:33 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 1073741824" returned: 0 in 0.920s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.472s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-63a8c5a2-7e06-40ca-9220-3b6102a6ef33 tempest-GroupSnapshotsTest-1895388299 None] Delete group completed successfully. Sep 08 19:20:33 devstack sudo[95206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 Sep 08 19:20:33 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:33 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa4c3b0-ff95-4486-b133-d1db179e24ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367fefdc-2480-42cd-b7a8-1a05680efc82', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418bf6d6-c2d1-44b8-af80-9db0c79adc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-657cf38a-728f-4df1-8a83-6e274493dc15 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-2010242116: creating Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Volume volume-367fefdc-2480-42cd-b7a8-1a05680efc82 (367fefdc-2480-42cd-b7a8-1a05680efc82): created successfully Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418bf6d6-c2d1-44b8-af80-9db0c79adc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Flow 'volume_create_manager' (d4ce885e-e650-4946-b2c5-ea6f001548d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ac66b2bc-5843-41a0-b052-5eca65253db7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Created volume successfully. Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-657cf38a-728f-4df1-8a83-6e274493dc15 tempest-GroupSnapshotsTest-1895388299 None] Group tempest-GroupSnapshotsTest-Group-2010242116: created successfully Sep 08 19:20:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-657cf38a-728f-4df1-8a83-6e274493dc15 tempest-GroupSnapshotsTest-1895388299 None] Create group completed successfully. Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=159,cinder:INSERT=39,cinder:UPDATE=156,cinder:DELETE=10 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:INSERT=36,cinder:UPDATE=164,cinder:SELECT=134,cinder:DELETE=4 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Creating offline snapshot 1662d409-37f7-4bdd-bade-fbcc877442cf of volume 367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[edea2bf7-931f-4ad6-a2ac-5983ef80b9f4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:34 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 Sep 08 19:20:34 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:35 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82" returned: 0 in 0.571s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:35 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf 1G Sep 08 19:20:35 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (cce10752-82a2-424a-ae80-1ebcbdd484fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75b8196-d52e-4ff6-bf52-5a1fdea052ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75b8196-d52e-4ff6-bf52-5a1fdea052ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-58578980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a43964e5-2f16-4bd0-ab36-5b5329cbca2d,host='devstack@QuobyteHD#QuobyteHD',id=99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:35Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f342dbb-135e-4c5b-be88-0a123fcdf07e),volume_type_id=9f342dbb-135e-4c5b-be88-0a123fcdf07e)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce6322-2531-4545-8443-f1493fb2f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce6322-2531-4545-8443-f1493fb2f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e44899-5af8-4315-abc6-ad1ba355f1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e44899-5af8-4315-abc6-ad1ba355f1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec', 'volume_name': 'volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f3c792-ab77-401e-9076-83037ce12f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61f3c792-ab77-401e-9076-83037ce12f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eddf29-8c16-4946-83ee-575750596eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Volume 99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec', 'volume_size': 1} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:35 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf 1G" returned: 0 in 0.923s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367fefdc-2480-42cd-b7a8-1a05680efc82 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:36 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367fefdc-2480-42cd-b7a8-1a05680efc82 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf Sep 08 19:20:36 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:36 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367fefdc-2480-42cd-b7a8-1a05680efc82 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf" returned: 0 in 0.515s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:36 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf is being set with open permissions: ugo+rw Sep 08 19:20:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:36 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf Sep 08 19:20:36 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:36 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:36 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info Sep 08 19:20:36 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info is being set with open permissions: ugo+rw Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:37 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info Sep 08 19:20:37 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.info" returned: 0 in 0.467s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.305s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a43964e5-2f16-4bd0-ab36-5b5329cbca2d,created_at=2026-09-08T17:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-58578980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a43964e5-2f16-4bd0-ab36-5b5329cbca2d,host='devstack@QuobyteHD#QuobyteHD',id=99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c769f9fccb84d239eacea484e4aefe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:35Z,use_quota=True,user_id='e3581c645332484c85bf46518ab4c597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f342dbb-135e-4c5b-be88-0a123fcdf07e),volume_type_id=9f342dbb-135e-4c5b-be88-0a123fcdf07e)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Creating volume 99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:37 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:37 devstack sudo[95306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec 1073741824 Sep 08 19:20:37 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6bb9843e-a458-4134-a5f1-d928a56c7b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Create snapshot completed successfully Sep 08 19:20:38 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec 1073741824" returned: 0 in 0.569s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:38 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec Sep 08 19:20:38 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:38 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" returned: 0 in 0.324s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eddf29-8c16-4946-83ee-575750596eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4599908-c21b-4a13-ac47-8da0da116757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Volume volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec (99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec): created successfully Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4599908-c21b-4a13-ac47-8da0da116757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Flow 'volume_create_manager' (cce10752-82a2-424a-ae80-1ebcbdd484fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1257df59-e998-491e-8159-f6661cdeda5d tempest-GroupSnapshotsTest-1895388299 None] Created volume successfully. Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "cinder-1662d409-37f7-4bdd-bade-fbcc877442cf-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-1662d409-37f7-4bdd-bade-fbcc877442cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "cinder-quobyte-1662d409-37f7-4bdd-bade-fbcc877442cf" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-1662d409-37f7-4bdd-bade-fbcc877442cf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Deleting offline snapshot 1662d409-37f7-4bdd-bade-fbcc877442cf of volume 367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] snapshot_file for this snap is: volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] GroupSnapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: creating. Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d77c83c-e754-4e26-b52c-c08514923c98]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Group snapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: creating. {{(pid=87521) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Creating offline snapshot f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 of volume 99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10e2935-43df-423f-9c29-67f825ef31b0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[95314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf Sep 08 19:20:40 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec Sep 08 19:20:40 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf" returned: 0 in 0.729s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-367fefdc-2480-42cd-b7a8-1a05680efc82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:40 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" returned: 0 in 0.678s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5d640d-657a-4377-90f7-0d288ae509d8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:40 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 1G Sep 08 19:20:40 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:40 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 Sep 08 19:20:40 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82" returned: 0 in 0.558s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf Sep 08 19:20:41 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 1G" returned: 0 in 0.774s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 Sep 08 19:20:41 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" returned: 0 in 0.412s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 Sep 08 19:20:41 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:41 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf" returned: 0 in 0.763s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:41 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf Sep 08 19:20:41 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" returned: 0 in 0.355s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:42 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info Sep 08 19:20:42 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82.1662d409-37f7-4bdd-bade-fbcc877442cf" returned: 0 in 0.521s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-1662d409-37f7-4bdd-bade-fbcc877442cf" released by "_delete_snapshot" :: held 2.787s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" released by "delete_snapshot" :: held 2.829s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Created reservations ['0adf14c0-b995-400c-9f70-7f3e6b09770c', 'f9429590-1897-429a-88a2-a5711e494ec5', 'cc2d4c83-37cd-463e-a8ce-8641ecabfb5d', 'b37f293d-050f-4bf3-a861-7b8cd980b126'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:42 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info" returned: 0 in 0.546s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:42 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Delete snapshot completed successfully. Sep 08 19:20:42 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info Sep 08 19:20:42 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4234a6de-891d-491f-af1d-e017ca122bf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-1662d409-37f7-4bdd-bade-fbcc877442cf-delete_snapshot" released by "delete_snapshot" :: held 3.116s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:43 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.info" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.241s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "cinder-367fefdc-2480-42cd-b7a8-1a05680efc82-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-367fefdc-2480-42cd-b7a8-1a05680efc82-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-12ca61ab-78a3-47e2-a1b2-4a57950117bc tempest-GroupSnapshotsTest-1895388299 None] group_snapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: created successfully Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb653c7e-1b5a-4925-b808-edcdf329c9a4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 Sep 08 19:20:43 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82" returned: 0 in 0.417s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:43 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82 Sep 08 19:20:43 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:43 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-367fefdc-2480-42cd-b7a8-1a05680efc82" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-quobyte-367fefdc-2480-42cd-b7a8-1a05680efc82" released by "delete_volume" :: held 0.745s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Created reservations ['9bcf5b9a-58a9-4c0e-8e20-77e57fe2980c', 'fc9f728f-80b6-4908-b507-ac8af876ccf4', 'e0a03524-67db-44df-b80b-cf3567c1bfbe', '4a2eba6d-3d34-4408-940d-d31ba1f5d73f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:44 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:44 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:44 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.326s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Deleted volume successfully. Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-eb8eb2ad-5c8f-4e86-b610-271b7d848d68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1522094282 None] Lock "cinder-367fefdc-2480-42cd-b7a8-1a05680efc82-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: deleting Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: deleting {{(pid=87521) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Deleting offline snapshot f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 of volume 99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] snapshot_file for this snap is: volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a19db1-e665-4a1b-81a8-5c84c41bdc1b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:44 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 Sep 08 19:20:44 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" returned: 0 in 0.567s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a853ace-d83c-4cf3-b4af-83bd3510845e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec Sep 08 19:20:45 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:45 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" returned: 0 in 0.517s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:45 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 Sep 08 19:20:45 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:46 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" returned: 0 in 0.544s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:46 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68 Sep 08 19:20:46 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:46 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec.f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-f8ef70d2-1f4e-41cc-b2a9-4dfdc48ebb68" released by "_delete_snapshot" :: held 2.131s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" released by "delete_snapshot" :: held 2.165s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:46 devstack cinder-volume[87521]: WARNING cinder.quota [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-669732542 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-669732542, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:46 devstack cinder-volume[87521]: WARNING cinder.quota [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-669732542 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-669732542, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:46 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['a0fc9a19-98fb-4fcf-b2f0-f9eac9826899', 'b7468dbb-dafb-4a32-9b02-431434ff2e21', 'e41c2e5b-1614-4e5a-b547-62d8eb07550e', '8faeeee9-8db8-4a4b-853f-d4c8a82d0034'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ae31c239-1d5a-44c2-955c-80860b377f27 tempest-GroupSnapshotsTest-1895388299 None] group_snapshot ae3886d4-42a4-42e5-b69c-f5fd96cf76cb: deleted successfully Sep 08 19:20:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:20:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bb9bea-dc91-4619-abfb-5ed3a0c44979]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:48 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec Sep 08 19:20:48 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:48 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" returned: 0 in 0.486s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:48 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec Sep 08 19:20:48 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:48 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" returned: 0 in 0.415s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Lock "cinder-quobyte-99dd96fe-cbd2-439c-a6ee-f4c125f3c4ec" released by "delete_volume" :: held 1.003s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['fe12758e-7825-42b9-bc6c-359befe28185'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:49 devstack cinder-volume[87521]: WARNING cinder.quota [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-669732542 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-669732542, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Created reservations ['188d2fd2-9fdd-4a26-aee9-bdbeed1bce17', 'a98752d2-0b51-4162-9641-1cd65ed390a0', '4748fbdc-947d-49ab-9df7-d1b471ad2278', '034a6120-297e-48a5-9f1b-82271986a84d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:49 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:20:49 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:49 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.316s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:20:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b5a8fb20-7ae5-44b0-9c4c-b3f720ac62ed tempest-GroupSnapshotsTest-1895388299 None] Delete group completed successfully. Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Flow 'volume_create_manager' (9118111f-8b5a-47fd-aedb-70665c844c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952b826e-bee6-47cc-8b24-606ef54d1e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952b826e-bee6-47cc-8b24-606ef54d1e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1911713385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79478046-6ec6-4790-a766-8f6db7fb96b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ef6515fa9b4d9aa017865dc7cc4a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='7b259cef0f9544b09de6dfff2d6a2acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1001619-82f0-444a-a3d9-5b7edd379fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1001619-82f0-444a-a3d9-5b7edd379fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb093c-9eb5-4108-9e52-142644ab331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:53 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eb093c-9eb5-4108-9e52-142644ab331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79478046-6ec6-4790-a766-8f6db7fb96b7', 'volume_name': 'volume-79478046-6ec6-4790-a766-8f6db7fb96b7', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a49de1-698e-4402-ae09-22ea1a358f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a49de1-698e-4402-ae09-22ea1a358f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa69bf1d-20c6-4aae-9868-0ba54f98d736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:20:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Volume 79478046-6ec6-4790-a766-8f6db7fb96b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79478046-6ec6-4790-a766-8f6db7fb96b7', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Trying to clone 79478046-6ec6-4790-a766-8f6db7fb96b7 from image 6b778823-fa2d-480a-aa07-bfb706774474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:20:54 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e3fe82-a782-46ba-889d-8f94a8c41bf5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:54 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD Sep 08 19:20:54 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:54 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:54 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 is fetched for user 7b259cef0f9544b09de6dfff2d6a2acf. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed78aa5-993b-452d-8081-0ea7a8466728]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD Sep 08 19:20:55 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1911713385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79478046-6ec6-4790-a766-8f6db7fb96b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1ef6515fa9b4d9aa017865dc7cc4a63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:20:53Z,use_quota=True,user_id='7b259cef0f9544b09de6dfff2d6a2acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Creating volume 79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:20:55 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1073741824 Sep 08 19:20:55 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:55 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1073741824" returned: 0 in 0.508s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:55 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 Sep 08 19:20:55 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7" returned: 0 in 0.287s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Attempting download of 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 79478046-6ec6-4790-a766-8f6db7fb96b7. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[855c3531-8c22-43e6-89b7-70a1f767601f]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d Sep 08 19:20:56 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:56 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:56 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d Sep 08 19:20:56 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:57 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d" returned: 1 in 0.398s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_6g1_gt1d' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d24c20-e32f-4d9d-b5c7-991bc254619d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:57 devstack sudo[95456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD Sep 08 19:20:57 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:57 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] 6b778823-fa2d-480a-aa07-bfb706774474 was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:20:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:57 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 Sep 08 19:20:57 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:20:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-81deeb65-ae4c-4c50-a6c5-74a268a07377 tempest-GroupSnapshotsV319Test-690864584 None] Group tempest-GroupSnapshotsV319Test-Group-93736304: creating Sep 08 19:20:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-81deeb65-ae4c-4c50-a6c5-74a268a07377 tempest-GroupSnapshotsV319Test-690864584 None] Group tempest-GroupSnapshotsV319Test-Group-93736304: created successfully Sep 08 19:20:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-81deeb65-ae4c-4c50-a6c5-74a268a07377 tempest-GroupSnapshotsV319Test-690864584 None] Create group completed successfully. Sep 08 19:20:59 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 08 19:20:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7" returned: 0 in 2.383s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:20:59 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_09dtvky7devstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:20:59 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Converted 112.00 MB image at 46.90 MB/s Sep 08 19:20:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:20:59 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1G Sep 08 19:20:59 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Flow 'volume_create_manager' (08b1913d-5314-4f81-81fe-7cf3650dc32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3f0963-9774-40d9-9fde-5df7f035b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3f0963-9774-40d9-9fde-5df7f035b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572192043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18efcb23-c007-4865-984f-b2aaca82ec7c,host='devstack@QuobyteHD#QuobyteHD',id=cf8a9cb6-0088-4606-bb6a-fa28411700e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb143d4cbc5648699ad56c2704672bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:00Z,use_quota=True,user_id='4fbc60511adb49788f792812ee4af3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a031dd38-22a1-437e-9552-2c1066b96595),volume_type_id=a031dd38-22a1-437e-9552-2c1066b96595)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3210fef9-329f-482e-b8f0-9c25bb9171e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3210fef9-329f-482e-b8f0-9c25bb9171e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59a511f-0fed-46f5-870d-1723edb7948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d59a511f-0fed-46f5-870d-1723edb7948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8a9cb6-0088-4606-bb6a-fa28411700e8', 'volume_name': 'volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80ec44-7743-4276-921a-8e973d6b3099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee80ec44-7743-4276-921a-8e973d6b3099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46b63ac-ce34-45fb-82b4-0c6026a54452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Volume cf8a9cb6-0088-4606-bb6a-fa28411700e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8', 'volume_size': 1} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18efcb23-c007-4865-984f-b2aaca82ec7c,created_at=2026-09-08T17:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1572192043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18efcb23-c007-4865-984f-b2aaca82ec7c,host='devstack@QuobyteHD#QuobyteHD',id=cf8a9cb6-0088-4606-bb6a-fa28411700e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb143d4cbc5648699ad56c2704672bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:00Z,use_quota=True,user_id='4fbc60511adb49788f792812ee4af3a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a031dd38-22a1-437e-9552-2c1066b96595),volume_type_id=a031dd38-22a1-437e-9552-2c1066b96595)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Creating volume cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:00 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:00 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 1073741824 Sep 08 19:21:00 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 1G" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Downloaded image 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 79478046-6ec6-4790-a766-8f6db7fb96b7 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 for user 7b259cef0f9544b09de6dfff2d6a2acf is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Marking volume 79478046-6ec6-4790-a766-8f6db7fb96b7 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Copying metadata from image 6b778823-fa2d-480a-aa07-bfb706774474 to 79478046-6ec6-4790-a766-8f6db7fb96b7. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Creating volume glance metadata for volume 79478046-6ec6-4790-a766-8f6db7fb96b7 backed by image 6b778823-fa2d-480a-aa07-bfb706774474 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa69bf1d-20c6-4aae-9868-0ba54f98d736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79478046-6ec6-4790-a766-8f6db7fb96b7', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf64006-973f-464e-949a-851edfb2f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Volume volume-79478046-6ec6-4790-a766-8f6db7fb96b7 (79478046-6ec6-4790-a766-8f6db7fb96b7): created successfully Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf64006-973f-464e-949a-851edfb2f931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Flow 'volume_create_manager' (9118111f-8b5a-47fd-aedb-70665c844c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0c3dc67e-39b6-4953-b753-a108594e2807 tempest-VolumesImageMetadata-43344560 None] Created volume successfully. Sep 08 19:21:00 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 1073741824" returned: 0 in 0.514s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:00 devstack sudo[95486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 Sep 08 19:21:00 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:00 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8" returned: 0 in 0.298s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46b63ac-ce34-45fb-82b4-0c6026a54452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc56a05-85e3-4266-af9b-7413a28c2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:01 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Volume volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 (cf8a9cb6-0088-4606-bb6a-fa28411700e8): created successfully Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbc56a05-85e3-4266-af9b-7413a28c2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Flow 'volume_create_manager' (08b1913d-5314-4f81-81fe-7cf3650dc32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d0827fe4-4c32-481b-8c6e-47bd41475129 tempest-GroupSnapshotsV319Test-690864584 None] Created volume successfully. Sep 08 19:21:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] GroupSnapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: creating. Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Group snapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: creating. {{(pid=87521) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Creating offline snapshot df59ecbd-efe8-4b76-92be-0de91df0b643 of volume cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5698de99-3c8d-4f6a-a2d2-856e2dbb9956]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:01 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 Sep 08 19:21:01 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Acquiring lock "cinder-79478046-6ec6-4790-a766-8f6db7fb96b7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "cinder-79478046-6ec6-4790-a766-8f6db7fb96b7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:01 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (b6ca6524-979f-4029-8dd9-9537e5cb5ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849aea5-b13d-44f7-b27d-ef32e1924bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1849aea5-b13d-44f7-b27d-ef32e1924bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1356718376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72685ac-8913-42f1-823d-0af9b84fcb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:02Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e038e-89c2-4b64-838f-8151c32c8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b4e038e-89c2-4b64-838f-8151c32c8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15d1b67-c114-4b67-be27-48c2f6e1585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15d1b67-c114-4b67-be27-48c2f6e1585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72685ac-8913-42f1-823d-0af9b84fcb03', 'volume_name': 'volume-c72685ac-8913-42f1-823d-0af9b84fcb03', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f43a867-5244-4e0b-9fdf-a796db3e1ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f43a867-5244-4e0b-9fdf-a796db3e1ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4379952b-09d4-4a1c-8d3b-086d80d0e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Volume c72685ac-8913-42f1-823d-0af9b84fcb03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72685ac-8913-42f1-823d-0af9b84fcb03', 'volume_size': 1} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Acquiring lock "cinder-quobyte-79478046-6ec6-4790-a766-8f6db7fb96b7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "cinder-quobyte-79478046-6ec6-4790-a766-8f6db7fb96b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e221106-7f09-4911-8859-e69b4855ca39]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:02 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8" returned: 0 in 0.475s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:02 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 1G Sep 08 19:21:02 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:02 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 Sep 08 19:21:02 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:02 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7" returned: 0 in 0.400s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:02 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7 Sep 08 19:21:02 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:02 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 1G" returned: 0 in 0.436s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:02 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 Sep 08 19:21:02 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:02 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-79478046-6ec6-4790-a766-8f6db7fb96b7" returned: 0 in 0.293s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "cinder-quobyte-79478046-6ec6-4790-a766-8f6db7fb96b7" released by "delete_volume" :: held 0.752s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:02 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Created reservations ['cde0cd88-82a5-4a6b-acd1-6a2469db7d77', '1417670d-e3d6-47df-bdb4-971db8f04b7b', '47afe75a-c5f9-417e-94d8-8ce70bc48d31', '1cae95fe-c17d-4cd1-a200-f6678f69fd62'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643" returned: 0 in 0.320s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:21:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:02 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 Sep 08 19:21:02 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:03 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643" returned: 0 in 0.310s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info Sep 08 19:21:03 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.323s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Deleted volume successfully. Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4bd8c56-3ef3-4443-b841-abd198ebb1a7 tempest-VolumesImageMetadata-43344560 None] Lock "cinder-79478046-6ec6-4790-a766-8f6db7fb96b7-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:03 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info" returned: 0 in 0.273s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info Sep 08 19:21:03 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:03 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.info" returned: 0 in 0.279s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.268s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.811s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1356718376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72685ac-8913-42f1-823d-0af9b84fcb03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:02Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Creating volume c72685ac-8913-42f1-823d-0af9b84fcb03 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:03 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:03 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 1073741824 Sep 08 19:21:03 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a3752590-013e-481f-9c87-e9adca7096ee tempest-GroupSnapshotsV319Test-690864584 None] group_snapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: created successfully Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (480ca49c-09f1-4225-acd0-ff3a0924bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7ae0a-a6f9-4458-9364-54ca72b88076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7ae0a-a6f9-4458-9364-54ca72b88076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-998363256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824e8146-1566-4716-99a4-3b477499f985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0d712a95354eaead49a18fe107b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:04Z,use_quota=True,user_id='dd568d5477fe44398b36e0c661f43818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df50d434-0134-48a5-aa7c-2fd4152a4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df50d434-0134-48a5-aa7c-2fd4152a4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c39b0-1c73-4692-bdb5-411ae2cf99c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (768c39b0-1c73-4692-bdb5-411ae2cf99c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '824e8146-1566-4716-99a4-3b477499f985', 'volume_name': 'volume-824e8146-1566-4716-99a4-3b477499f985', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8adac-ba8e-4e91-ae6e-01e3de8b54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe8adac-ba8e-4e91-ae6e-01e3de8b54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f1b50-2cb4-4897-b706-2238760d111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Volume 824e8146-1566-4716-99a4-3b477499f985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-824e8146-1566-4716-99a4-3b477499f985', 'volume_size': 1} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:04 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 1073741824" returned: 0 in 0.625s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:04 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 Sep 08 19:21:04 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-998363256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=824e8146-1566-4716-99a4-3b477499f985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0d712a95354eaead49a18fe107b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:04Z,use_quota=True,user_id='dd568d5477fe44398b36e0c661f43818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Creating volume 824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:04 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4379952b-09d4-4a1c-8d3b-086d80d0e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72685ac-8913-42f1-823d-0af9b84fcb03', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e6cf2b-1e68-419f-8d6a-605563b3edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:04 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 1073741824 Sep 08 19:21:04 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:04 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Volume volume-c72685ac-8913-42f1-823d-0af9b84fcb03 (c72685ac-8913-42f1-823d-0af9b84fcb03): created successfully Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e6cf2b-1e68-419f-8d6a-605563b3edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (b6ca6524-979f-4029-8dd9-9537e5cb5ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6b082114-5309-4fbc-9612-dce5d2661478 tempest-AttachVolumeTestJSON-1538188774 None] Created volume successfully. Sep 08 19:21:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] group_snapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: deleting Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] group_snapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: deleting {{(pid=87521) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "cinder-quobyte-df59ecbd-efe8-4b76-92be-0de91df0b643" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-df59ecbd-efe8-4b76-92be-0de91df0b643" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Deleting offline snapshot df59ecbd-efe8-4b76-92be-0de91df0b643 of volume cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:05 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] snapshot_file for this snap is: volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 1073741824" returned: 0 in 0.728s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f452047-8b67-4c00-b7c2-34c8d03f180e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:05 devstack sudo[95550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 Sep 08 19:21:05 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:05 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 Sep 08 19:21:05 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985" returned: 0 in 0.420s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485f1b50-2cb4-4897-b706-2238760d111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-824e8146-1566-4716-99a4-3b477499f985', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536a202f-dcf1-4b91-b458-2bbf6b45d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Volume volume-824e8146-1566-4716-99a4-3b477499f985 (824e8146-1566-4716-99a4-3b477499f985): created successfully Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536a202f-dcf1-4b91-b458-2bbf6b45d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (480ca49c-09f1-4225-acd0-ff3a0924bddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:06 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643" returned: 0 in 0.579s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3e0e5273-b87f-4dae-892e-354f0af7e15f tempest-VolumesDeleteCascade-1876287320 None] Created volume successfully. Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c554b8-d8be-4171-9fbd-9bf20bfcfd68]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-163dbe3c-8447-48ac-b8ea-6ec2bb60e43e req-1830e248-3d89-400b-9672-4b6ce49eec8a tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-163dbe3c-8447-48ac-b8ea-6ec2bb60e43e req-1830e248-3d89-400b-9672-4b6ce49eec8a tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-163dbe3c-8447-48ac-b8ea-6ec2bb60e43e req-1830e248-3d89-400b-9672-4b6ce49eec8a tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-163dbe3c-8447-48ac-b8ea-6ec2bb60e43e req-1830e248-3d89-400b-9672-4b6ce49eec8a tempest-AttachVolumeTestJSON-1538188774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-c72685ac-8913-42f1-823d-0af9b84fcb03', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7439d91d-c3ca-40ba-940e-7c44c29ab701', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:21:06 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 Sep 08 19:21:06 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-163dbe3c-8447-48ac-b8ea-6ec2bb60e43e req-1830e248-3d89-400b-9672-4b6ce49eec8a tempest-AttachVolumeTestJSON-1538188774 None] attachment_update completed successfully. Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Creating offline snapshot deec8745-7c65-4769-ac42-7a009dbdbea2 of volume 824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:06 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8" returned: 0 in 0.549s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6792b6-6928-448a-943f-d2580c3a5236]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:06 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 Sep 08 19:21:06 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 Sep 08 19:21:07 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985" returned: 0 in 0.496s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643 Sep 08 19:21:07 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 1G Sep 08 19:21:07 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:07 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8.df59ecbd-efe8-4b76-92be-0de91df0b643" returned: 0 in 0.306s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-df59ecbd-efe8-4b76-92be-0de91df0b643" released by "_delete_snapshot" :: held 2.122s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" released by "delete_snapshot" :: held 2.156s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:07 devstack cinder-volume[87521]: WARNING cinder.quota [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1539831476 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1539831476, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:21:07 devstack cinder-volume[87521]: WARNING cinder.quota [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1539831476 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1539831476, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] Created reservations ['46a017f9-722f-45b0-95e9-874ed6560195', '154375ea-d70d-46cf-95bb-e6e4fd311537', 'e0725017-6368-4d94-bf11-f5cd4dad1255', '4bafbeba-25d3-4128-a5dd-15fd65701cc2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:07 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 1G" returned: 0 in 0.505s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-382cac93-b62f-44d1-ad9c-4cdce7923dbf tempest-GroupSnapshotsV319Test-690864584 None] group_snapshot eb19f9d4-1c43-4517-be47-a73f0f12353e: deleted successfully Sep 08 19:21:07 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:07 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Flow 'volume_create_manager' (33032185-e04a-4453-84c2-3ed4e1a21adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8672bfa-05be-41e3-bf92-b9ab2b25e537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8672bfa-05be-41e3-bf92-b9ab2b25e537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-455505857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7bf08c-94cd-4306-9cd1-c1d8f40973c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27772a3f08b040909973cdc606e78d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:08Z,use_quota=True,user_id='6ae0b1b7205f4bfda3133509e14db6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271a04e5-7f27-49ef-ae41-212c8c61e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (271a04e5-7f27-49ef-ae41-212c8c61e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c39027-d45a-4fa9-8673-17ec2b771ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87c39027-d45a-4fa9-8673-17ec2b771ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de7bf08c-94cd-4306-9cd1-c1d8f40973c1', 'volume_name': 'volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeab22b8-2ae7-4250-85be-f9ad041ee16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeab22b8-2ae7-4250-85be-f9ad041ee16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad992bb-c5d0-4b38-af4e-41bfdb42f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:08 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Volume de7bf08c-94cd-4306-9cd1-c1d8f40973c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1', 'volume_size': 1} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.438s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:08 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 is being set with open permissions: ugo+rw Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:08 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f08b39a-39f7-4640-94e5-d81604a49585]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 Sep 08 19:21:08 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info Sep 08 19:21:08 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8" returned: 0 in 0.412s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8 Sep 08 19:21:08 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info" returned: 0 in 0.317s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:08 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info is being set with open permissions: ugo+rw Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:08 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info Sep 08 19:21:08 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (70b9eb5a-a721-4429-9017-6b9abc34ec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f2a789-5772-4f34-9f57-93d3a7f474a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39f2a789-5772-4f34-9f57-93d3a7f474a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-108944560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f13c59-6a24-4fac-961b-80f4f3678831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:09Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf588ef-1168-4da4-852e-53238a6dd3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf588ef-1168-4da4-852e-53238a6dd3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec1b347-653d-4f65-b0dc-6b573eb2204f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bec1b347-653d-4f65-b0dc-6b573eb2204f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f13c59-6a24-4fac-961b-80f4f3678831', 'volume_name': 'volume-97f13c59-6a24-4fac-961b-80f4f3678831', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78506acc-30a0-4464-9bc4-4e74480a87d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78506acc-30a0-4464-9bc4-4e74480a87d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04f437-967c-4255-b39d-a69ab1517f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:09 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Volume 97f13c59-6a24-4fac-961b-80f4f3678831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f13c59-6a24-4fac-961b-80f4f3678831', 'volume_size': 1} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:09 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cf8a9cb6-0088-4606-bb6a-fa28411700e8" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Lock "cinder-quobyte-cf8a9cb6-0088-4606-bb6a-fa28411700e8" released by "delete_volume" :: held 0.771s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:09 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.info" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-455505857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de7bf08c-94cd-4306-9cd1-c1d8f40973c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27772a3f08b040909973cdc606e78d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:08Z,use_quota=True,user_id='6ae0b1b7205f4bfda3133509e14db6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Creating volume de7bf08c-94cd-4306-9cd1-c1d8f40973c1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:09 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 1073741824 Sep 08 19:21:09 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-739d1b9c-388d-4c02-a6b2-512bea6684a5 tempest-VolumesDeleteCascade-1876287320 None] Create snapshot completed successfully Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Created reservations ['f96ee2c8-7e59-4726-9afc-31d20ce1a2a7'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:09 devstack cinder-volume[87521]: WARNING cinder.quota [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1539831476 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1539831476, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Created reservations ['8ba7fcbb-21e7-4d53-af02-e378ec5a6300', '74750ed8-2e9b-4e40-a046-c3fcb1d8feab', '5fadd1ca-a7dc-42b2-8829-532e0a325a00', 'd9aa4f15-90fc-4e99-9d00-a041233f615b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:09 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 1073741824" returned: 0 in 0.480s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.308s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ac09fd4e-a307-4584-b5b9-9f0746654ebc tempest-GroupSnapshotsV319Test-690864584 None] Delete group completed successfully. Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:09 devstack sudo[96011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 Sep 08 19:21:09 devstack sudo[96011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:09 devstack sudo[96011]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.962s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-108944560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f13c59-6a24-4fac-961b-80f4f3678831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029517baca664d3ba5e90ed074d3c4a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:09Z,use_quota=True,user_id='aaf7abb29bc64cafa578420f2bab2442',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Creating volume 97f13c59-6a24-4fac-961b-80f4f3678831 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:10 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:10 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 1073741824 Sep 08 19:21:10 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad992bb-c5d0-4b38-af4e-41bfdb42f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209fcf9c-a644-4fe2-a49e-98f781e18e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Volume volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 (de7bf08c-94cd-4306-9cd1-c1d8f40973c1): created successfully Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (209fcf9c-a644-4fe2-a49e-98f781e18e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Flow 'volume_create_manager' (33032185-e04a-4453-84c2-3ed4e1a21adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a72fe6d2-8699-4d27-908c-8ec87da8762f tempest-VolumesMetadataTest-1406342517 None] Created volume successfully. Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:10 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 1073741824" returned: 0 in 0.570s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:10 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 Sep 08 19:21:10 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:10 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.780s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef04f437-967c-4255-b39d-a69ab1517f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f13c59-6a24-4fac-961b-80f4f3678831', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98542fe1-6eaa-492f-bde8-40d42645d5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Creating offline snapshot a2df0111-8979-4022-8369-dc6060279fad of volume 824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Volume volume-97f13c59-6a24-4fac-961b-80f4f3678831 (97f13c59-6a24-4fac-961b-80f4f3678831): created successfully Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98542fe1-6eaa-492f-bde8-40d42645d5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Flow 'volume_create_manager' (70b9eb5a-a721-4429-9017-6b9abc34ec5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ce8c3d-4e75-41ee-b731-547e81adeeb2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0b814709-fb64-4afd-8f82-c1343f49b0fb tempest-AttachVolumeTestJSON-1538188774 None] Created volume successfully. Sep 08 19:21:11 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:11 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Acquiring lock "cinder-de7bf08c-94cd-4306-9cd1-c1d8f40973c1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "cinder-de7bf08c-94cd-4306-9cd1-c1d8f40973c1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Acquiring lock "cinder-quobyte-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "cinder-quobyte-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d53850-07d8-49f8-acf3-1820f440c70c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.447s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824e8146-1566-4716-99a4-3b477499f985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad 1G Sep 08 19:21:11 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 Sep 08 19:21:11 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:11 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" returned: 0 in 0.421s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:11 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1 Sep 08 19:21:11 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad 1G" returned: 0 in 0.542s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad Sep 08 19:21:12 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "cinder-quobyte-de7bf08c-94cd-4306-9cd1-c1d8f40973c1" released by "delete_volume" :: held 0.820s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Created reservations ['abcbca5c-ec85-4764-b0b5-4a213e3fd2bc', 'e95308b4-119f-422f-a082-812501c523e9', '440919c7-cd97-4192-bec0-f8037fe438a4', 'ef5fb022-c62a-40dd-97f3-40ca9ebbd6e1'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:12 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad" returned: 0 in 0.480s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad is being set with open permissions: ugo+rw Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:12 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad Sep 08 19:21:12 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:12 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.435s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Deleted volume successfully. Sep 08 19:21:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-72a80204-3805-46f4-be2f-b52da1ad51ee tempest-VolumesMetadataTest-1406342517 None] Lock "cinder-de7bf08c-94cd-4306-9cd1-c1d8f40973c1-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:13 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad" returned: 0 in 0.462s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ea09a4a5-16fd-41a0-8bb9-25888d614417 tempest-VolumesDeleteCascade-1876287320 None] Create snapshot completed successfully Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d06c5232-8754-4894-a703-949347e5f2fc req-956e578d-375c-4802-8674-9d42eba7e2f5 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d06c5232-8754-4894-a703-949347e5f2fc req-956e578d-375c-4802-8674-9d42eba7e2f5 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d06c5232-8754-4894-a703-949347e5f2fc req-956e578d-375c-4802-8674-9d42eba7e2f5 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d06c5232-8754-4894-a703-949347e5f2fc req-956e578d-375c-4802-8674-9d42eba7e2f5 tempest-AttachVolumeTestJSON-1538188774 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-97f13c59-6a24-4fac-961b-80f4f3678831', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5169eab2-44ce-4de0-a74a-5b160e9c3199', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:21:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-d06c5232-8754-4894-a703-949347e5f2fc req-956e578d-375c-4802-8674-9d42eba7e2f5 tempest-AttachVolumeTestJSON-1538188774 None] attachment_update completed successfully. Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-824e8146-1566-4716-99a4-3b477499f985-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-824e8146-1566-4716-99a4-3b477499f985-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Performing cascade delete. {{(pid=87521) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-a2df0111-8979-4022-8369-dc6060279fad-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-a2df0111-8979-4022-8369-dc6060279fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-a2df0111-8979-4022-8369-dc6060279fad" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-a2df0111-8979-4022-8369-dc6060279fad" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Deleting offline snapshot a2df0111-8979-4022-8369-dc6060279fad of volume 824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] snapshot_file for this snap is: volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f61eda4-63b6-4a3c-849a-986a285b5a03]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:13 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad Sep 08 19:21:13 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad" returned: 0 in 0.505s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824e8146-1566-4716-99a4-3b477499f985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[65289be1-f1a8-4b29-928c-13a60d6dfab3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:14 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:14 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.454s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824e8146-1566-4716-99a4-3b477499f985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:14 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad Sep 08 19:21:14 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:15 devstack sudo[96087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:15 devstack sudo[96087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad" returned: 0 in 0.535s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:15 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad Sep 08 19:21:15 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:15 devstack sudo[96087]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.470s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 28 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:21:15 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.a2df0111-8979-4022-8369-dc6060279fad" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-a2df0111-8979-4022-8369-dc6060279fad" released by "_delete_snapshot" :: held 1.977s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" released by "delete_snapshot" :: held 2.003s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['177acb23-74e5-4353-9727-c301f6f13a87', '8ad82467-240a-414f-b861-708a2086a083', '4086eac2-8fca-4f9f-b343-98d78d779a64', 'a7e7ec66-cdf7-4055-8775-5a337fb62288'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Delete snapshot completed successfully. Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-a2df0111-8979-4022-8369-dc6060279fad-delete_snapshot" released by "delete_snapshot" :: held 2.223s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-deec8745-7c65-4769-ac42-7a009dbdbea2-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-deec8745-7c65-4769-ac42-7a009dbdbea2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-deec8745-7c65-4769-ac42-7a009dbdbea2" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-deec8745-7c65-4769-ac42-7a009dbdbea2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Deleting offline snapshot deec8745-7c65-4769-ac42-7a009dbdbea2 of volume 824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] snapshot_file for this snap is: volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8a8300-f7d5-4e1e-8531-41f3e3f42510]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:16 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.448s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-824e8146-1566-4716-99a4-3b477499f985(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba05e8e-fd31-4e0b-8594-7f8fecf9f7d2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-cff66670-c0fc-4bd1-8851-abd26a4f322b req-f8674384-17b8-4286-835f-410aebe2af45 tempest-AttachVolumeTestJSON-1538188774 None] Terminate volume connection completed successfully. Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-cff66670-c0fc-4bd1-8851-abd26a4f322b req-f8674384-17b8-4286-835f-410aebe2af45 tempest-AttachVolumeTestJSON-1538188774 None] Deleting attachment 7439d91d-c3ca-40ba-940e-7c44c29ab701. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:21:16 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 Sep 08 19:21:16 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:16 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985" returned: 0 in 0.430s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:16 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:16 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:17 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.439s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:17 devstack sudo[96115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2 Sep 08 19:21:17 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:17 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985.deec8745-7c65-4769-ac42-7a009dbdbea2" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-deec8745-7c65-4769-ac42-7a009dbdbea2" released by "_delete_snapshot" :: held 1.770s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" released by "delete_snapshot" :: held 1.805s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['5d44e446-7068-4161-8c3c-f0f4810db537', 'dbd0df84-9875-41c6-b16d-e6c3dbaf9d24', '04c2743a-b206-4185-a992-136e5d05512f', '86dd6325-57ce-4bce-bd79-fcafb832a807'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Delete snapshot completed successfully. Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-deec8745-7c65-4769-ac42-7a009dbdbea2-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Snapshots deleted, issuing volume delete {{(pid=87521) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7638c85-b43d-4e9a-a20e-73b462cca8cb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-fabda209-eac1-4a6b-a373-1432e11ed735 req-973c1ce0-80e9-42b6-bbda-2f839020bcd7 tempest-AttachVolumeTestJSON-1538188774 None] Terminate volume connection completed successfully. Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-fabda209-eac1-4a6b-a373-1432e11ed735 req-973c1ce0-80e9-42b6-bbda-2f839020bcd7 tempest-AttachVolumeTestJSON-1538188774 None] Deleting attachment 5169eab2-44ce-4de0-a74a-5b160e9c3199. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:21:18 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 Sep 08 19:21:18 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:18 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985" returned: 0 in 0.579s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:18 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985 Sep 08 19:21:18 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:18 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-824e8146-1566-4716-99a4-3b477499f985" returned: 0 in 0.316s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-824e8146-1566-4716-99a4-3b477499f985" released by "delete_volume" :: held 1.021s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:18 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['a91d7706-6257-4574-af00-fba0496d4762', '03975f11-e9d8-4226-9aeb-471021fa0243', '3201c378-1554-40a5-89bf-8f444cbc4e8e', 'a1070ef2-950a-4c04-851d-f21f089698e9'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:19 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:19 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:19 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.410s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Deleted volume successfully. Sep 08 19:21:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b3911c57-e074-4f86-9c45-fcfa6624f09d tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-824e8146-1566-4716-99a4-3b477499f985-delete_volume" released by "delete_volume" :: held 6.100s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (1adb26a7-395a-4903-9622-afb0bee10223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfd62be-77d0-4170-a4dd-23eea6e38176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfd62be-77d0-4170-a4dd-23eea6e38176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-389862376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0160053f-17fa-4a84-96c9-cae8eba962d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0d712a95354eaead49a18fe107b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:21Z,use_quota=True,user_id='dd568d5477fe44398b36e0c661f43818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b46a99-7542-4f58-b27b-2c2d668d852b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b46a99-7542-4f58-b27b-2c2d668d852b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4714406d-1550-492c-9eb1-50400b1e52d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4714406d-1550-492c-9eb1-50400b1e52d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0160053f-17fa-4a84-96c9-cae8eba962d7', 'volume_name': 'volume-0160053f-17fa-4a84-96c9-cae8eba962d7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb5991-0ec6-4927-8ed8-9b07e9c561b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7eb5991-0ec6-4927-8ed8-9b07e9c561b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef1116a-3d3e-47f8-89fa-10d196a52bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:20 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Volume 0160053f-17fa-4a84-96c9-cae8eba962d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0160053f-17fa-4a84-96c9-cae8eba962d7', 'volume_size': 1} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-389862376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0160053f-17fa-4a84-96c9-cae8eba962d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0d712a95354eaead49a18fe107b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:21Z,use_quota=True,user_id='dd568d5477fe44398b36e0c661f43818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Creating volume 0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:20 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:20 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 1073741824 Sep 08 19:21:20 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Flow 'volume_create_manager' (6106736c-4ed4-470b-9028-1844cf7df5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4937a1f-3f34-4e07-94fc-6fb3cee7792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4937a1f-3f34-4e07-94fc-6fb3cee7792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1763864355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7553603-c1c2-46c7-9c06-ea91cd219c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4bd6bf72fe04045b122534dfb90cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:21Z,use_quota=True,user_id='cb6bcce31e1d4aaf84e9ea86fe1de17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8772c0bf-a590-4498-8034-9267862fbf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8772c0bf-a590-4498-8034-9267862fbf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3748d44-7cf3-418a-ac9b-e5467b866f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3748d44-7cf3-418a-ac9b-e5467b866f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7553603-c1c2-46c7-9c06-ea91cd219c98', 'volume_name': 'volume-a7553603-c1c2-46c7-9c06-ea91cd219c98', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991c0ac6-be09-4962-8294-548283814ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991c0ac6-be09-4962-8294-548283814ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fd2b57-4b4c-4a28-b215-6269f801d743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Volume a7553603-c1c2-46c7-9c06-ea91cd219c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7553603-c1c2-46c7-9c06-ea91cd219c98', 'volume_size': 1} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:21 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 1073741824" returned: 0 in 0.692s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:21 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:21 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:21 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.422s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1763864355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7553603-c1c2-46c7-9c06-ea91cd219c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4bd6bf72fe04045b122534dfb90cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:21Z,use_quota=True,user_id='cb6bcce31e1d4aaf84e9ea86fe1de17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Creating volume a7553603-c1c2-46c7-9c06-ea91cd219c98 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:21 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:21 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 1073741824 Sep 08 19:21:21 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef1116a-3d3e-47f8-89fa-10d196a52bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0160053f-17fa-4a84-96c9-cae8eba962d7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1211a8d5-b11c-4c01-9bc4-41a60e7d0c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Volume volume-0160053f-17fa-4a84-96c9-cae8eba962d7 (0160053f-17fa-4a84-96c9-cae8eba962d7): created successfully Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1211a8d5-b11c-4c01-9bc4-41a60e7d0c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (1adb26a7-395a-4903-9622-afb0bee10223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a9c1b5d4-94a2-4143-8aed-ab063e21a707 tempest-VolumesDeleteCascade-1876287320 None] Created volume successfully. Sep 08 19:21:22 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 1073741824" returned: 0 in 0.563s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:22 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 Sep 08 19:21:22 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:22 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86fd2b57-4b4c-4a28-b215-6269f801d743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7553603-c1c2-46c7-9c06-ea91cd219c98', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d439f47f-21b4-4aa1-92d1-3e20a5e0fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:22 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Volume volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 (a7553603-c1c2-46c7-9c06-ea91cd219c98): created successfully Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d439f47f-21b4-4aa1-92d1-3e20a5e0fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Flow 'volume_create_manager' (6106736c-4ed4-470b-9028-1844cf7df5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4fcdfac8-cfba-45aa-915e-129c2249bbf4 tempest-VolumesTransfersV355Test-878709631 None] Created volume successfully. Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Creating offline snapshot d8449cf9-ec65-49aa-bcad-94f5b5b16e8d of volume 0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:21:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[41622651-4f04-4b87-a422-89466318be2a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:23 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:23 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:23 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.460s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:23 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d 1G Sep 08 19:21:23 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-97f13c59-6a24-4fac-961b-80f4f3678831-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d 1G" returned: 0 in 0.573s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0160053f-17fa-4a84-96c9-cae8eba962d7 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-97f13c59-6a24-4fac-961b-80f4f3678831-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:24 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0160053f-17fa-4a84-96c9-cae8eba962d7 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:24 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-quobyte-97f13c59-6a24-4fac-961b-80f4f3678831" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-97f13c59-6a24-4fac-961b-80f4f3678831" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed403b-e177-4350-abc9-58f216a605bb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[96217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 Sep 08 19:21:24 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0160053f-17fa-4a84-96c9-cae8eba962d7 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.466s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d is being set with open permissions: ugo+rw Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:24 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e4db97bd-501c-424a-a14e-05f83e650d59 tempest-VolumesTransfersV355Test-753129915 None] Transfer volume completed successfully. Sep 08 19:21:24 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831" returned: 0 in 0.482s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[96227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831 Sep 08 19:21:24 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:24 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:24 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info Sep 08 19:21:24 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-97f13c59-6a24-4fac-961b-80f4f3678831" returned: 0 in 0.288s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-97f13c59-6a24-4fac-961b-80f4f3678831" released by "delete_volume" :: held 0.833s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Created reservations ['cd1f643d-bb93-4479-a3c9-359b8d73fbb8', 'f387ab78-06f9-4d85-ac8e-2545c5d95034', 'b2a35ca7-14a6-4a39-9e40-18ea9f4697c9', 'fa372a1f-8a06-4a72-9850-725c6ffbabf2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:25 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:25 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:25 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info is being set with open permissions: ugo+rw Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-c72685ac-8913-42f1-823d-0af9b84fcb03-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info Sep 08 19:21:25 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-c72685ac-8913-42f1-823d-0af9b84fcb03-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "cinder-a7553603-c1c2-46c7-9c06-ea91cd219c98-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-a7553603-c1c2-46c7-9c06-ea91cd219c98-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-quobyte-c72685ac-8913-42f1-823d-0af9b84fcb03" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-c72685ac-8913-42f1-823d-0af9b84fcb03" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "cinder-quobyte-a7553603-c1c2-46c7-9c06-ea91cd219c98" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e7b2c2-af80-488e-b6fc-221432b94083]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-quobyte-a7553603-c1c2-46c7-9c06-ea91cd219c98" acquired by "delete_volume" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[447149fc-16f3-44c1-afb0-2a7152364962]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:25 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.info" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:25 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:25 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 Sep 08 19:21:25 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.441s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Deleted volume successfully. Sep 08 19:21:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d7a9f690-b885-4681-b557-8393b742d373 tempest-VolumesDeleteCascade-1876287320 None] Create snapshot completed successfully Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4a2d150a-f356-4550-aa73-5174b428c848 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-97f13c59-6a24-4fac-961b-80f4f3678831-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:25 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 Sep 08 19:21:25 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:25 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03" returned: 0 in 0.434s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03 Sep 08 19:21:26 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98" returned: 0 in 0.454s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98 Sep 08 19:21:26 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c72685ac-8913-42f1-823d-0af9b84fcb03" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-c72685ac-8913-42f1-823d-0af9b84fcb03" released by "delete_volume" :: held 0.776s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Created reservations ['94a54181-6b30-426d-9c21-4e1338df0e39', '99187f05-cb80-4fb8-8979-8b5566905695', 'befc71e5-047c-48be-bfbe-e42a4b1f0200', '9f0947fb-8d7f-498e-8c96-6de99eb2cd7a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:26 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7553603-c1c2-46c7-9c06-ea91cd219c98" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-quobyte-a7553603-c1c2-46c7-9c06-ea91cd219c98" released by "delete_volume" :: held 0.799s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:26 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Created reservations ['8bafea96-dd59-4018-a7ca-ed0a155134ad', 'e6b1ccc2-fcbc-4866-af9e-ab002acdc05f', '5807951b-4174-4a92-875d-925a0d53c85e', 'd5953ec5-4ec6-442b-97d2-2f70d97f0f19'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:26 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:26 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-6612906a-98fa-4ddc-b937-96540bb28eb8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-6612906a-98fa-4ddc-b937-96540bb28eb8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "cinder-quobyte-6612906a-98fa-4ddc-b937-96540bb28eb8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-6612906a-98fa-4ddc-b937-96540bb28eb8" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:26 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.396s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.561s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:26 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Deleted volume successfully. Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d649e4-fac4-49ad-af21-42619e9ca1c0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5f946ecd-16d4-4504-a94e-34ef75da30a8 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-a7553603-c1c2-46c7-9c06-ea91cd219c98-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Deleted volume successfully. Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (c5247029-cd0a-4e8c-979d-7c0023f141a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac1ec5a-21ee-40b0-9ca5-6b1a010cc13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35461432-3d3d-4495-b474-a5cf26a09580 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-c72685ac-8913-42f1-823d-0af9b84fcb03-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:27 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 Sep 08 19:21:27 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac1ec5a-21ee-40b0-9ca5-6b1a010cc13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2087045616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c74bba0a-48d2-4f93-8b4a-822218d3e04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0d712a95354eaead49a18fe107b0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8449cf9-ec65-49aa-bcad-94f5b5b16e8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:27Z,use_quota=True,user_id='dd568d5477fe44398b36e0c661f43818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3b22c1-03e3-49e5-99a8-53149e78b687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3b22c1-03e3-49e5-99a8-53149e78b687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ff62c3-6dad-49a5-af6c-9f5820977187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83ff62c3-6dad-49a5-af6c-9f5820977187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c74bba0a-48d2-4f93-8b4a-822218d3e04b', 'volume_name': 'volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b', 'volume_size': 1, 'snapshot_id': 'd8449cf9-ec65-49aa-bcad-94f5b5b16e8d'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7854427-5e86-47ed-ade5-829ed9778dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7854427-5e86-47ed-ade5-829ed9778dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ed660-8fed-4bd8-ae4b-a342a633fc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Volume c74bba0a-48d2-4f93-8b4a-822218d3e04b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b', 'volume_size': 1, 'snapshot_id': 'd8449cf9-ec65-49aa-bcad-94f5b5b16e8d'} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-c74bba0a-48d2-4f93-8b4a-822218d3e04b" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-c74bba0a-48d2-4f93-8b4a-822218d3e04b" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Creating volume c74bba0a-48d2-4f93-8b4a-822218d3e04b from snapshot d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] snapshot: d8449cf9-ec65-49aa-bcad-94f5b5b16e8d, volume: c74bba0a-48d2-4f93-8b4a-822218d3e04b, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d03926-f99f-4a2b-8405-d314e528605a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:27 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:27 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:27 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8" returned: 0 in 0.515s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:27 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8 Sep 08 19:21:27 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Flow 'volume_create_manager' (b2ce3f4a-b17c-4fe9-8f0d-70e117d214bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b523e-53d3-42b9-91db-0c43c45190dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4b523e-53d3-42b9-91db-0c43c45190dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-638970464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50560736-f7c6-4449-993c-a71ede5aeec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4bd6bf72fe04045b122534dfb90cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:27Z,use_quota=True,user_id='cb6bcce31e1d4aaf84e9ea86fe1de17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d004df22-0f5e-4a00-9ad4-00b80f1fa33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d004df22-0f5e-4a00-9ad4-00b80f1fa33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d4a268-d52d-45c6-be76-0b7410948c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d4a268-d52d-45c6-be76-0b7410948c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50560736-f7c6-4449-993c-a71ede5aeec8', 'volume_name': 'volume-50560736-f7c6-4449-993c-a71ede5aeec8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843ad0c1-0082-494d-8ef6-40ca807ecf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843ad0c1-0082-494d-8ef6-40ca807ecf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03da56f5-854a-4751-ab4b-201724319c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Volume 50560736-f7c6-4449-993c-a71ede5aeec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50560736-f7c6-4449-993c-a71ede5aeec8', 'volume_size': 1} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:27 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6612906a-98fa-4ddc-b937-96540bb28eb8" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:27 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.432s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0160053f-17fa-4a84-96c9-cae8eba962d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-quobyte-6612906a-98fa-4ddc-b937-96540bb28eb8" released by "delete_volume" :: held 0.875s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c932b491-a427-4d4b-8fa7-6b2f9ee02e04]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:27 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Created reservations ['15476ac8-0579-46c9-8bc9-f66fa8a4b74d', '6e9c5baa-3b86-4576-b0c8-0e98b664967a', '92960394-ffcf-4f3d-a5bd-3a1dd1605b7e', '908fa6a5-e0d0-4c15-90cb-d7bbde709c12'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:27 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:27 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:28 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:28 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:28 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.482s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:28 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.315s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Deleted volume successfully. Sep 08 19:21:28 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b Sep 08 19:21:28 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-edf85a71-841c-4825-9cfc-12823167c005 tempest-AttachVolumeTestJSON-1538188774 None] Lock "cinder-6612906a-98fa-4ddc-b937-96540bb28eb8-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b" returned: 0 in 5.956s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7, size 1024.00 MB, duration 5.96 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:21:34 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Converted 1024.00 MB image at 171.90 MB/s Sep 08 19:21:34 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b is being set with open permissions: ugo+rw Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:34 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b Sep 08 19:21:34 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:34 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b" returned: 0 in 0.293s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" released by "_copy_volume_from_snapshot" :: held 7.272s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=156,cinder:UPDATE=153,cinder:INSERT=51,cinder:DELETE=8 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=157,cinder:UPDATE=162,cinder:DELETE=13,cinder:INSERT=38 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-c74bba0a-48d2-4f93-8b4a-822218d3e04b" released by "_create_volume_from_snapshot" :: held 7.405s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.433s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-638970464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50560736-f7c6-4449-993c-a71ede5aeec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4bd6bf72fe04045b122534dfb90cc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:27Z,use_quota=True,user_id='cb6bcce31e1d4aaf84e9ea86fe1de17b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Creating volume 50560736-f7c6-4449-993c-a71ede5aeec8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:34 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:34 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 1073741824 Sep 08 19:21:34 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690ed660-8fed-4bd8-ae4b-a342a633fc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b', 'volume_size': 1, 'snapshot_id': 'd8449cf9-ec65-49aa-bcad-94f5b5b16e8d'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a560304e-5dc9-4181-82ed-e26a11b4a5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:34 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Volume volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b (c74bba0a-48d2-4f93-8b4a-822218d3e04b): created successfully Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a560304e-5dc9-4181-82ed-e26a11b4a5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Flow 'volume_create_manager' (c5247029-cd0a-4e8c-979d-7c0023f141a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-663676ec-9b7f-407f-ae27-02fda6df3669 tempest-VolumesDeleteCascade-1876287320 None] Created volume successfully. Sep 08 19:21:35 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 1073741824" returned: 0 in 0.607s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:35 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 Sep 08 19:21:35 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:35 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03da56f5-854a-4751-ab4b-201724319c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50560736-f7c6-4449-993c-a71ede5aeec8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67267985-2f0d-4ae9-a8cd-f38a9d7717ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Volume volume-50560736-f7c6-4449-993c-a71ede5aeec8 (50560736-f7c6-4449-993c-a71ede5aeec8): created successfully Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67267985-2f0d-4ae9-a8cd-f38a9d7717ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Flow 'volume_create_manager' (b2ce3f4a-b17c-4fe9-8f0d-70e117d214bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-52a52913-e991-4c44-ae04-11a003baba1c tempest-VolumesTransfersV355Test-878709631 None] Created volume successfully. Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-0160053f-17fa-4a84-96c9-cae8eba962d7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-0160053f-17fa-4a84-96c9-cae8eba962d7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Performing cascade delete. {{(pid=87521) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Deleting offline snapshot d8449cf9-ec65-49aa-bcad-94f5b5b16e8d of volume 0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] snapshot_file for this snap is: volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa049e7-6830-419c-a60f-ce367133ba9a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:36 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:36 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:36 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.422s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0160053f-17fa-4a84-96c9-cae8eba962d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a5943-1bbb-48c0-93bb-286b77dcd874]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:36 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:36 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "cinder-50560736-f7c6-4449-993c-a71ede5aeec8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-50560736-f7c6-4449-993c-a71ede5aeec8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "cinder-quobyte-50560736-f7c6-4449-993c-a71ede5aeec8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-quobyte-50560736-f7c6-4449-993c-a71ede5aeec8" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a791613a-c1df-4597-9d39-a3c319934bfc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:37 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 Sep 08 19:21:37 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:37 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.680s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:37 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:37 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:37 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8" returned: 0 in 0.461s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:37 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8 Sep 08 19:21:37 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:37 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.416s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:37 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d Sep 08 19:21:37 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:37 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-50560736-f7c6-4449-993c-a71ede5aeec8" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-quobyte-50560736-f7c6-4449-993c-a71ede5aeec8" released by "delete_volume" :: held 0.796s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:37 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Created reservations ['85412aef-b193-47f4-8874-7fb43de20f8a', 'feb27c77-c543-4d73-84fe-cb6e35b0e230', 'c4fcb4fd-f04e-42b1-8a5a-874cfc232009', '9366686b-0f3e-47e0-920e-98c321a1bfdb'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:38 devstack sudo[96381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:38 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:38 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7.d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d" released by "_delete_snapshot" :: held 2.019s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" released by "delete_snapshot" :: held 2.050s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['a74be501-3d5c-4054-81b3-0b44d3250198', '4ceaab09-c4fc-41ef-bfc9-d3daf08110f6', 'e9d455fe-c157-437d-b854-aa5c42417539', '37234a8e-41e7-4b04-8776-a6501a5829c7'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Delete snapshot completed successfully. Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-d8449cf9-ec65-49aa-bcad-94f5b5b16e8d-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Snapshots deleted, issuing volume delete {{(pid=87521) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb27ee03-c7a6-47f5-9300-6c233b267bd7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:38 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.473s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Deleted volume successfully. Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-147ff868-27ed-4c98-8c21-fc48da131753 tempest-VolumesTransfersV355Test-1530317655 None] Lock "cinder-50560736-f7c6-4449-993c-a71ede5aeec8-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:38 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:38 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Flow 'volume_create_manager' (d7cd93d2-cc8b-4038-990e-1955ed2ff6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005d296-7e0c-4a24-b0bd-4e617c7e51e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9005d296-7e0c-4a24-b0bd-4e617c7e51e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555560355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba03c37-a1cf-42b0-a073-d233fef77104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287b3da27de442c8e094faac6a0b2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:39Z,use_quota=True,user_id='b039ee6426d04d0eb97210130207f8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba82c03-67c0-4f7f-bb1b-e32f1d52283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba82c03-67c0-4f7f-bb1b-e32f1d52283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e6999b-2ca0-4165-849f-f720c66be0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e6999b-2ca0-4165-849f-f720c66be0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dba03c37-a1cf-42b0-a073-d233fef77104', 'volume_name': 'volume-dba03c37-a1cf-42b0-a073-d233fef77104', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35fd364-475f-47c7-90c0-6b5c44dbc443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b35fd364-475f-47c7-90c0-6b5c44dbc443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3030bfd-ed44-4951-a3f2-4f3b827627e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume dba03c37-a1cf-42b0-a073-d233fef77104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dba03c37-a1cf-42b0-a073-d233fef77104', 'volume_size': 1} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-555560355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dba03c37-a1cf-42b0-a073-d233fef77104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287b3da27de442c8e094faac6a0b2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:39Z,use_quota=True,user_id='b039ee6426d04d0eb97210130207f8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Creating volume dba03c37-a1cf-42b0-a073-d233fef77104 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:38 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:38 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.466s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:39 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 1073741824 Sep 08 19:21:39 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:39 devstack sudo[96391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7 Sep 08 19:21:39 devstack sudo[96391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:39 devstack sudo[96391]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0160053f-17fa-4a84-96c9-cae8eba962d7" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-0160053f-17fa-4a84-96c9-cae8eba962d7" released by "delete_volume" :: held 0.931s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['bf602bd4-4058-4a90-8a19-8587e2c09869', 'e4717231-5c6c-4d01-8f2e-5a3e22f49700', 'a097211b-e836-45f5-a646-8f55fc521431', '12ff89f4-302d-4ab8-b9bd-b53f447a9071'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:39 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 1073741824" returned: 0 in 0.627s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:39 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:39 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:39 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 Sep 08 19:21:39 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:39 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Deleted volume successfully. Sep 08 19:21:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1c302f42-d6a3-4ae0-8f05-955cb26c841c tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-0160053f-17fa-4a84-96c9-cae8eba962d7-delete_volume" released by "delete_volume" :: held 3.945s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:40 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3030bfd-ed44-4951-a3f2-4f3b827627e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dba03c37-a1cf-42b0-a073-d233fef77104', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331035f8-534e-49df-934b-3a1f944e8626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:40 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume volume-dba03c37-a1cf-42b0-a073-d233fef77104 (dba03c37-a1cf-42b0-a073-d233fef77104): created successfully Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331035f8-534e-49df-934b-3a1f944e8626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Flow 'volume_create_manager' (d7cd93d2-cc8b-4038-990e-1955ed2ff6e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-14ae00e3-3a47-4eda-9d5f-0736a84a320b tempest-VolumeQuotasAdminTestJSON-1429723036 None] Created volume successfully. Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-c74bba0a-48d2-4f93-8b4a-822218d3e04b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-c74bba0a-48d2-4f93-8b4a-822218d3e04b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d0c24b-5d6b-48fc-8a53-ba25a0d2e3b0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:40 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b Sep 08 19:21:40 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "cinder-dba03c37-a1cf-42b0-a073-d233fef77104-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "cinder-dba03c37-a1cf-42b0-a073-d233fef77104-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "cinder-quobyte-dba03c37-a1cf-42b0-a073-d233fef77104" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "cinder-quobyte-dba03c37-a1cf-42b0-a073-d233fef77104" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d5eb42-7798-42e5-805f-0c05ef4bee5e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:41 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:41 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b Sep 08 19:21:41 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:41 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 Sep 08 19:21:41 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:41 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c74bba0a-48d2-4f93-8b4a-822218d3e04b" returned: 0 in 0.360s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-quobyte-c74bba0a-48d2-4f93-8b4a-822218d3e04b" released by "delete_volume" :: held 0.920s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:41 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104" returned: 0 in 0.503s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:41 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104 Sep 08 19:21:41 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Created reservations ['158c72f4-2fab-408f-9d99-2580d882beea', '849d5464-100d-4b0e-b5e4-da18fd3ba911', '779f5065-cf93-48aa-87d6-92e77335d3f3', 'd9d030cf-b963-468b-b38c-636e5bc8f66a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:41 devstack sudo[96420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:41 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:42 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dba03c37-a1cf-42b0-a073-d233fef77104" returned: 0 in 0.424s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "cinder-quobyte-dba03c37-a1cf-42b0-a073-d233fef77104" released by "delete_volume" :: held 0.995s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:42 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Created reservations ['3b747c44-45c6-4063-bc15-0f32d74356db', '1f289bc2-9abb-457a-9850-47b48d4340f7', 'fc63ba39-5d39-4b82-a7df-f52a4905780c', 'a663db71-b19f-428a-abe0-c5eca5a62ae6'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.379s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Deleted volume successfully. Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2a080b4b-46bb-4126-b43b-30edae586a57 tempest-VolumesDeleteCascade-1876287320 None] Lock "cinder-c74bba0a-48d2-4f93-8b4a-822218d3e04b-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:42 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:42 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:42 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Deleted volume successfully. Sep 08 19:21:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0c3fa1d6-13a1-4771-89ad-f9de597d0790 tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "cinder-dba03c37-a1cf-42b0-a073-d233fef77104-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Flow 'volume_create_manager' (a27727cb-fe02-4b18-8570-b56f18e6b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616032ca-91d0-49b9-9d73-c6dfecb56cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616032ca-91d0-49b9-9d73-c6dfecb56cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-655538706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4269bc8b-5f5e-4c3d-88c6-1647e9c04f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287b3da27de442c8e094faac6a0b2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:44Z,use_quota=True,user_id='b039ee6426d04d0eb97210130207f8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50268f67-abe3-4f67-a45e-88978a9cb2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50268f67-abe3-4f67-a45e-88978a9cb2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938a7662-8298-4575-8479-f188709606dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938a7662-8298-4575-8479-f188709606dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4269bc8b-5f5e-4c3d-88c6-1647e9c04f37', 'volume_name': 'volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82813d63-60e1-40e3-bd16-05ff26c5ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82813d63-60e1-40e3-bd16-05ff26c5ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37c0c2c-7633-4f03-b8f3-e3d5cec84115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume 4269bc8b-5f5e-4c3d-88c6-1647e9c04f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37', 'volume_size': 1} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-655538706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4269bc8b-5f5e-4c3d-88c6-1647e9c04f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0287b3da27de442c8e094faac6a0b2c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:44Z,use_quota=True,user_id='b039ee6426d04d0eb97210130207f8ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Creating volume 4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:44 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:44 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 1073741824 Sep 08 19:21:44 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:44 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 1073741824" returned: 0 in 0.621s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:45 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 Sep 08 19:21:45 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:45 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" returned: 0 in 0.338s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37c0c2c-7633-4f03-b8f3-e3d5cec84115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f41c25-5045-43df-bf52-197e939f3a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Volume volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 (4269bc8b-5f5e-4c3d-88c6-1647e9c04f37): created successfully Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f41c25-5045-43df-bf52-197e939f3a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Flow 'volume_create_manager' (a27727cb-fe02-4b18-8570-b56f18e6b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b8dfe1c9-4f5c-4d6f-918d-35f30a591f4f tempest-VolumeQuotasAdminTestJSON-1429723036 None] Created volume successfully. Sep 08 19:21:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bdd9cb42-74d5-4e7f-a5d0-8aef6bcf69fb tempest-VolumeQuotasAdminTestJSON-162078580 None] Transfer volume completed successfully. Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Acquiring lock "cinder-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "cinder-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Acquiring lock "cinder-quobyte-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "cinder-quobyte-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2f5594-ad35-4822-ae53-6def869db8d9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Flow 'volume_create_manager' (02d354af-14cc-4356-a877-8b1fb1039df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e366fc5e-d8dc-4007-932a-757f024044fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e366fc5e-d8dc-4007-932a-757f024044fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1561923302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c57dca5-5777-4306-b18f-f3fe98c68358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b42239f18f47b3b14a8f8c04aa6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:49Z,use_quota=True,user_id='774db4041f7d478d986df95f01ca4b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ade98-41f8-4015-96d5-bae2d5958407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (806ade98-41f8-4015-96d5-bae2d5958407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:48 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8ac67b-41ee-4bf0-b407-4268923c1982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:48 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:48 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:21:49 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" returned: 0 in 0.516s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8ac67b-41ee-4bf0-b407-4268923c1982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c57dca5-5777-4306-b18f-f3fe98c68358', 'volume_name': 'volume-2c57dca5-5777-4306-b18f-f3fe98c68358', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:49 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37 Sep 08 19:21:49 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caffd90-d6eb-48ef-9f34-a9c9e4b4870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4caffd90-d6eb-48ef-9f34-a9c9e4b4870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b87e725-9c28-4bb0-b7f8-988f021e2b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Volume 2c57dca5-5777-4306-b18f-f3fe98c68358: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c57dca5-5777-4306-b18f-f3fe98c68358', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Trying to clone 2c57dca5-5777-4306-b18f-f3fe98c68358 from image 6b778823-fa2d-480a-aa07-bfb706774474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:21:49 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" returned: 0 in 0.377s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "cinder-quobyte-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37" released by "delete_volume" :: held 0.965s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Created reservations ['d6dd3892-1669-45cc-a7a0-be334f828ba8', '5d62fc23-3a59-49fa-9696-710db7527ae9', 'ddf6cbf8-cac7-4f90-9895-dfe9a8ffbb91', 'e2b0b2a6-a2b1-48dc-9fdc-5b3172265d72'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:21:49 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[601829f2-0d27-4dbb-af5f-aad334f56812]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:49 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:21:49 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:49 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD Sep 08 19:21:49 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:50 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.445s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:21:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Deleted volume successfully. Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-510e71d0-515f-4fb9-9e40-6532cad67181 tempest-VolumeQuotasAdminTestJSON-690592707 None] Lock "cinder-4269bc8b-5f5e-4c3d-88c6-1647e9c04f37-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:21:50 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD" returned: 0 in 0.625s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 is fetched for user 774db4041f7d478d986df95f01ca4b1d. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2ac894-af32-4790-bc54-ba5dd4801e77]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:50 devstack sudo[96454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD Sep 08 19:21:50 devstack sudo[96454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:50 devstack sudo[96454]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1561923302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c57dca5-5777-4306-b18f-f3fe98c68358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b42239f18f47b3b14a8f8c04aa6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:21:49Z,use_quota=True,user_id='774db4041f7d478d986df95f01ca4b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Creating volume 2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:21:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:51 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1073741824 Sep 08 19:21:51 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:51 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1073741824" returned: 0 in 0.624s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:51 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 Sep 08 19:21:51 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:52 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Attempting download of 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 2c57dca5-5777-4306-b18f-f3fe98c68358. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b75f4-cf00-4ebd-8039-3a722ea8c59b]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:52 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc Sep 08 19:21:52 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:52 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc" returned: 0 in 0.401s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:52 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc Sep 08 19:21:52 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:53 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc" returned: 1 in 0.428s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_d6igjluc' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[df139fa3-83e9-4637-8fb6-bc569fafe74c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:53 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD Sep 08 19:21:53 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:53 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD" returned: 0 in 0.447s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] 6b778823-fa2d-480a-aa07-bfb706774474 was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:21:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:53 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 Sep 08 19:21:53 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:55 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358" returned: 0 in 2.235s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_ir5zoigzdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:21:55 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Converted 112.00 MB image at 50.08 MB/s Sep 08 19:21:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:55 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1G Sep 08 19:21:55 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:56 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 1G" returned: 0 in 0.467s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Downloaded image 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 2c57dca5-5777-4306-b18f-f3fe98c68358 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 for user 774db4041f7d478d986df95f01ca4b1d is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Marking volume 2c57dca5-5777-4306-b18f-f3fe98c68358 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Copying metadata from image 6b778823-fa2d-480a-aa07-bfb706774474 to 2c57dca5-5777-4306-b18f-f3fe98c68358. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Creating volume glance metadata for volume 2c57dca5-5777-4306-b18f-f3fe98c68358 backed by image 6b778823-fa2d-480a-aa07-bfb706774474 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b87e725-9c28-4bb0-b7f8-988f021e2b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c57dca5-5777-4306-b18f-f3fe98c68358', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5911346a-02ee-4ceb-b79f-f316cec68130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:21:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Volume volume-2c57dca5-5777-4306-b18f-f3fe98c68358 (2c57dca5-5777-4306-b18f-f3fe98c68358): created successfully Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5911346a-02ee-4ceb-b79f-f316cec68130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:21:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Flow 'volume_create_manager' (02d354af-14cc-4356-a877-8b1fb1039df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:21:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4dedf617-43d6-45c9-aa60-3ad479135f66 tempest-VolumesExtendTest-296970183 None] Created volume successfully. Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee93d6dd-4555-4f74-8562-9036d7d3ef3a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:57 devstack sudo[96506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 Sep 08 19:21:57 devstack sudo[96506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:57 devstack sudo[96506]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358" returned: 0 in 0.470s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 2G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 2G" returned: 0 in 0.152s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.658s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:21:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-07f2960c-929f-4261-8cb2-fe53682af51b tempest-VolumesExtendTest-296970183 None] Extend volume completed successfully. Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-2c57dca5-5777-4306-b18f-f3fe98c68358-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "cinder-2c57dca5-5777-4306-b18f-f3fe98c68358-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-quobyte-2c57dca5-5777-4306-b18f-f3fe98c68358" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-2c57dca5-5777-4306-b18f-f3fe98c68358" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b97517-1ece-43f8-9ec6-be19616f3d40]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:21:59 devstack sudo[96526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 Sep 08 19:21:59 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:21:59 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358" returned: 0 in 0.612s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:21:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:00 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358 Sep 08 19:22:00 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:00 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2c57dca5-5777-4306-b18f-f3fe98c68358" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-2c57dca5-5777-4306-b18f-f3fe98c68358" released by "delete_volume" :: held 1.047s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Created reservations ['4ce2b7d0-bd66-42ab-985d-836ecf541c60', 'e06bdb89-2d0c-40a5-aeff-5b496fb1f605', '7552628b-7bba-4bba-affd-3ae4ea6b9509', '89ec4d7b-1adb-45de-8bd5-7de621a5dd5f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:00 devstack sudo[96541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:00 devstack sudo[96541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:00 devstack sudo[96541]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.305s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Deleted volume successfully. Sep 08 19:22:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-968a4094-27e9-418e-bd4c-a80de734f929 tempest-VolumesExtendTest-296970183 None] Lock "cinder-2c57dca5-5777-4306-b18f-f3fe98c68358-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Flow 'volume_create_manager' (8ebc579f-5e40-4821-a123-af1f44d99200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a96109d-2d7a-435a-b4ac-02ac4c7eb105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a96109d-2d7a-435a-b4ac-02ac4c7eb105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1587326495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62d94b9-301e-448b-ad5a-fa8d84bdd39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b42239f18f47b3b14a8f8c04aa6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:02Z,use_quota=True,user_id='774db4041f7d478d986df95f01ca4b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef67e9b-7b4b-4e58-a54f-b92b1613bcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ef67e9b-7b4b-4e58-a54f-b92b1613bcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fa6ad4-3435-4651-ba41-683863ff75b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68fa6ad4-3435-4651-ba41-683863ff75b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62d94b9-301e-448b-ad5a-fa8d84bdd39e', 'volume_name': 'volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002d80d7-e445-44c9-8486-acb65e5034c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (002d80d7-e445-44c9-8486-acb65e5034c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100d28ba-7e7c-4f3a-ba75-111dbf264682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Volume c62d94b9-301e-448b-ad5a-fa8d84bdd39e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e', 'volume_size': 1} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1587326495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c62d94b9-301e-448b-ad5a-fa8d84bdd39e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1b42239f18f47b3b14a8f8c04aa6611',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:02Z,use_quota=True,user_id='774db4041f7d478d986df95f01ca4b1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Creating volume c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:02 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:02 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e 1073741824 Sep 08 19:22:02 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:03 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e 1073741824" returned: 0 in 0.739s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:03 devstack sudo[96588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:03 devstack sudo[96588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:03 devstack sudo[96588]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100d28ba-7e7c-4f3a-ba75-111dbf264682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4fbc5e-f86c-4aea-93f1-f816b2ade3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Volume volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e (c62d94b9-301e-448b-ad5a-fa8d84bdd39e): created successfully Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4fbc5e-f86c-4aea-93f1-f816b2ade3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Flow 'volume_create_manager' (8ebc579f-5e40-4821-a123-af1f44d99200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9057064c-85ad-4ef6-b584-b8d26c41e5ef tempest-VolumesExtendTest-296970183 None] Created volume successfully. Sep 08 19:22:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Creating offline snapshot 40dd85cb-403c-4b11-9a21-c1dcd8686652 of volume c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:22:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f0da8f-b57b-462f-a405-def3ab86d9e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:04 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:04 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:05 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.670s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:05 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 1G Sep 08 19:22:05 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:06 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 1G" returned: 0 in 0.760s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:06 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 Sep 08 19:22:06 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:06 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:06 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 is being set with open permissions: ugo+rw Sep 08 19:22:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:06 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 Sep 08 19:22:06 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:07 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652" returned: 0 in 0.600s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:07 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info Sep 08 19:22:07 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:07 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info" returned: 0 in 0.620s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:07 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info is being set with open permissions: ugo+rw Sep 08 19:22:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:08 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info Sep 08 19:22:08 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:08 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.info" returned: 0 in 0.418s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.652s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1300fbaa-8c3b-4ca8-8046-1a4a6e11bb46 tempest-VolumesExtendTest-296970183 None] Create snapshot completed successfully Sep 08 19:22:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:09 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d2ff1-4c36-4e07-8f17-dcf5612fcd7b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:09 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:09 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:10 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.758s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 2G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 2G" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.068s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-83d0c0bc-d176-470d-931a-65c58d621374 tempest-VolumesExtendTest-296970183 None] Extend volume completed successfully. Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-40dd85cb-403c-4b11-9a21-c1dcd8686652-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-40dd85cb-403c-4b11-9a21-c1dcd8686652-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-quobyte-40dd85cb-403c-4b11-9a21-c1dcd8686652" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-40dd85cb-403c-4b11-9a21-c1dcd8686652" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Deleting offline snapshot 40dd85cb-403c-4b11-9a21-c1dcd8686652 of volume c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] snapshot_file for this snap is: volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdb0767-2b29-4998-ba49-febce76a3ce1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:11 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 Sep 08 19:22:11 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:11 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652" returned: 0 in 0.659s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[453b77e0-4d37-421e-a44d-47a682ffeace]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:12 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:12 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:12 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.570s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:12 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 Sep 08 19:22:12 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:13 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652" returned: 0 in 0.637s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:13 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652 Sep 08 19:22:13 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:13 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e.40dd85cb-403c-4b11-9a21-c1dcd8686652" returned: 0 in 0.421s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-40dd85cb-403c-4b11-9a21-c1dcd8686652" released by "_delete_snapshot" :: held 2.544s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" released by "delete_snapshot" :: held 2.592s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Created reservations ['a548ed45-d385-4e2b-8882-a07442c54cd0', '837671d2-bc30-43dc-ac34-d0541b7b664d', '7eaf9caa-a19b-4f84-8bcf-c4401bcf71eb', '273ef2ec-789d-4c02-a2ca-09622cbde056'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Delete snapshot completed successfully. Sep 08 19:22:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-67528fc1-112f-4e50-9232-9c9ba64a2b98 tempest-VolumesExtendTest-296970183 None] Lock "cinder-40dd85cb-403c-4b11-9a21-c1dcd8686652-delete_snapshot" released by "delete_snapshot" :: held 2.849s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-c62d94b9-301e-448b-ad5a-fa8d84bdd39e-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "cinder-c62d94b9-301e-448b-ad5a-fa8d84bdd39e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Acquiring lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d680456-a59c-48ec-894b-21648f199ead]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:14 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:14 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:15 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.568s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:15 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e Sep 08 19:22:15 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:15 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:15 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:15 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" returned: 0 in 0.385s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "cinder-quobyte-c62d94b9-301e-448b-ad5a-fa8d84bdd39e" released by "delete_volume" :: held 1.055s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:15 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.529s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Created reservations ['e3cbfea1-8da5-4a67-9b45-47a0c43ebc35', '23bd8a78-8290-4281-9539-2575701a1445', 'fac423e0-4972-428d-80c4-a092cef04ac3', '0d4e56da-28bb-46f4-958d-6d13a1c5f304'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:15 devstack sudo[96701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:15 devstack sudo[96701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:16 devstack sudo[96701]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:16 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Deleted volume successfully. Sep 08 19:22:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4b0158c3-0e38-4716-b369-ec433d7d143f tempest-VolumesExtendTest-296970183 None] Lock "cinder-c62d94b9-301e-448b-ad5a-fa8d84bdd39e-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (b4f4cfc1-d6c7-4f13-bf36-f23b5cee2219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12769cd5-fc7c-4fe4-89c3-3e32012eac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12769cd5-fc7c-4fe4-89c3-3e32012eac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147145474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:21Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bdde5b-ea7e-4675-acd8-584a1dc4c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bdde5b-ea7e-4675-acd8-584a1dc4c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f4f87-bb5c-4488-83b9-d8387045fa57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a7f4f87-bb5c-4488-83b9-d8387045fa57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da', 'volume_name': 'volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a8631f-a910-4403-ba8d-bc34e4052cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a8631f-a910-4403-ba8d-bc34e4052cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34854665-ccd5-4338-91b6-8ef5e9741c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Volume 1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da', 'volume_size': 1} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-147145474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:21Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Creating volume 1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:21 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:21 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da 1073741824 Sep 08 19:22:21 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:21 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (09e73787-693c-448b-a95b-361785cd911b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d81d4-2bda-41b3-9d69-5782f42a39a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da 1073741824" returned: 0 in 0.540s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d81d4-2bda-41b3-9d69-5782f42a39a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1352147832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b1a1e-97bc-4ae6-a2af-d3b36991de05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:22Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b8092f-7bc1-4170-9f21-3fcfef05674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b8092f-7bc1-4170-9f21-3fcfef05674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceec9aaa-dad2-4aef-b811-2ac7c74c9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceec9aaa-dad2-4aef-b811-2ac7c74c9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4b1a1e-97bc-4ae6-a2af-d3b36991de05', 'volume_name': 'volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128d0b9e-d12c-4cc0-86ef-73f53d67ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128d0b9e-d12c-4cc0-86ef-73f53d67ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eef68b0-5a5a-4802-9ef0-b1f534263bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Volume 6c4b1a1e-97bc-4ae6-a2af-d3b36991de05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05', 'volume_size': 1} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:21 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da Sep 08 19:22:21 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:22 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" returned: 0 in 0.322s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1352147832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b1a1e-97bc-4ae6-a2af-d3b36991de05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:22Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Creating volume 6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:22 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34854665-ccd5-4338-91b6-8ef5e9741c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:22 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 1073741824 Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aa4fee-0356-4139-8a43-954c34a1b993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:22 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:22 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Volume volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da (1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da): created successfully Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95aa4fee-0356-4139-8a43-954c34a1b993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (b4f4cfc1-d6c7-4f13-bf36-f23b5cee2219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5d5ae875-1538-4bbe-b0ed-39bbacf13e13 tempest-VolumesListAdminTestJSON-24210814 None] Created volume successfully. Sep 08 19:22:22 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 1073741824" returned: 0 in 0.521s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:22 devstack sudo[96738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 Sep 08 19:22:22 devstack sudo[96738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:22 devstack sudo[96738]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eef68b0-5a5a-4802-9ef0-b1f534263bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2667dbd4-4892-4c52-a981-831305e6c94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Volume volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 (6c4b1a1e-97bc-4ae6-a2af-d3b36991de05): created successfully Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2667dbd4-4892-4c52-a981-831305e6c94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (09e73787-693c-448b-a95b-361785cd911b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:23 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-95454033-dc62-4e1d-9b1c-8402b98e2c07 tempest-VolumesListTestJSON-1965680811 None] Created volume successfully. Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (e56abf48-acfb-4e39-b2dc-a4707a4917c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed33b1a5-ff4e-4c31-8af0-a7e3c475b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed33b1a5-ff4e-4c31-8af0-a7e3c475b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434243558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0921a8f2-983c-4402-9dba-613455c574f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:24Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8d6487-6343-4828-ae02-5968b3ca7030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8d6487-6343-4828-ae02-5968b3ca7030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd08b08-8a86-4e5b-9dc2-91eeb4525dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd08b08-8a86-4e5b-9dc2-91eeb4525dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0921a8f2-983c-4402-9dba-613455c574f2', 'volume_name': 'volume-0921a8f2-983c-4402-9dba-613455c574f2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46de879d-063c-4dc7-b3ca-6257be4623b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46de879d-063c-4dc7-b3ca-6257be4623b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d908c54-5f22-4c45-af01-13cc572d6609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Volume 0921a8f2-983c-4402-9dba-613455c574f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0921a8f2-983c-4402-9dba-613455c574f2', 'volume_size': 1} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-434243558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0921a8f2-983c-4402-9dba-613455c574f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:24Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Creating volume 0921a8f2-983c-4402-9dba-613455c574f2 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:23 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:23 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 1073741824 Sep 08 19:22:23 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (ee84a0fb-3aa4-492b-8378-087abc839563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb4fcdf-024a-4460-a666-d3e6dd15c079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb4fcdf-024a-4460-a666-d3e6dd15c079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-623497013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d9f07-2874-4a1b-8048-2c702a6ee2cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:24Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4b3a2f-48e3-4a55-9b11-08086f9f2e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4b3a2f-48e3-4a55-9b11-08086f9f2e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617fa86-efc9-4c4a-b2dd-aac174c12de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617fa86-efc9-4c4a-b2dd-aac174c12de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '254d9f07-2874-4a1b-8048-2c702a6ee2cc', 'volume_name': 'volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7ca377-ac15-424a-8587-214ef3461595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f7ca377-ac15-424a-8587-214ef3461595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fecacf-64cf-44a8-ab02-74c4c38efc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Volume 254d9f07-2874-4a1b-8048-2c702a6ee2cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc', 'volume_size': 1} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 1073741824" returned: 0 in 0.559s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:24 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 Sep 08 19:22:24 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:24 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-623497013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=254d9f07-2874-4a1b-8048-2c702a6ee2cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:24Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Creating volume 254d9f07-2874-4a1b-8048-2c702a6ee2cc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:24 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d908c54-5f22-4c45-af01-13cc572d6609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0921a8f2-983c-4402-9dba-613455c574f2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc 1073741824 Sep 08 19:22:24 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70e7e42-c8fc-4ffa-a8f8-87b04fab1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Volume volume-0921a8f2-983c-4402-9dba-613455c574f2 (0921a8f2-983c-4402-9dba-613455c574f2): created successfully Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70e7e42-c8fc-4ffa-a8f8-87b04fab1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (e56abf48-acfb-4e39-b2dc-a4707a4917c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-27ea54bf-fc63-4e61-8651-47b449695611 tempest-VolumesListAdminTestJSON-24210814 None] Created volume successfully. Sep 08 19:22:25 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc 1073741824" returned: 0 in 0.578s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:25 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc Sep 08 19:22:25 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:25 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc" returned: 0 in 0.298s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fecacf-64cf-44a8-ab02-74c4c38efc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac41120-ba15-4dda-a6e5-6e3733ee488b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:25 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Volume volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc (254d9f07-2874-4a1b-8048-2c702a6ee2cc): created successfully Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac41120-ba15-4dda-a6e5-6e3733ee488b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (ee84a0fb-3aa4-492b-8378-087abc839563) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8827ec6f-cc90-49ad-8349-9c911ab20032 tempest-VolumesListTestJSON-1965680811 None] Created volume successfully. Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (680e7396-f395-4931-8dc0-8773d517f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5677b9-56c0-4673-9319-f44d0e805a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5677b9-56c0-4673-9319-f44d0e805a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108375992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd373dc5-67f1-4363-804c-4c77d4a4f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:26Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ecbc22-8ec6-4891-afd4-47dce9f5243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ecbc22-8ec6-4891-afd4-47dce9f5243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7a1923-8147-49af-98ba-e085ea3ecc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7a1923-8147-49af-98ba-e085ea3ecc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd373dc5-67f1-4363-804c-4c77d4a4f04d', 'volume_name': 'volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fd5a59-b451-4fbb-937a-6604f2655754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fd5a59-b451-4fbb-937a-6604f2655754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968cdb99-c85c-4a96-a61b-e8a90a1e9ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:26 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Volume dd373dc5-67f1-4363-804c-4c77d4a4f04d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d', 'volume_size': 1} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2108375992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd373dc5-67f1-4363-804c-4c77d4a4f04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4a7da50710d4b58951b93c0caa5b72b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:26Z,use_quota=True,user_id='bec7be707dcd495ab294a7962ef3fa58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Creating volume dd373dc5-67f1-4363-804c-4c77d4a4f04d {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:26 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:26 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d 1073741824 Sep 08 19:22:26 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (83b52e39-958a-4cdc-89b5-9f918e90530b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b89bb57-354b-48ba-9438-910a3e4722b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b89bb57-354b-48ba-9438-910a3e4722b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472015807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc80bd0-03f2-4c97-8cab-cdb4bebfd639,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:27Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7f8c24-4cbd-4712-a5d6-68b1f24269c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be7f8c24-4cbd-4712-a5d6-68b1f24269c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a2d165-938a-4198-a6a4-03b40b950e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55a2d165-938a-4198-a6a4-03b40b950e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dc80bd0-03f2-4c97-8cab-cdb4bebfd639', 'volume_name': 'volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc45eb3-11bf-40bf-9388-e6a6080000d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc45eb3-11bf-40bf-9388-e6a6080000d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c95ff1-c8e7-4dce-9266-5b126c7e5140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Volume 3dc80bd0-03f2-4c97-8cab-cdb4bebfd639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639', 'volume_size': 1} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d 1073741824" returned: 0 in 0.651s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:27 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d Sep 08 19:22:27 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:27 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d" returned: 0 in 0.280s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1472015807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dc80bd0-03f2-4c97-8cab-cdb4bebfd639,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='880d4595b2cd487eb00b0b51f256f693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:27Z,use_quota=True,user_id='49b5fd32f87348a8b02bdc980569d593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Creating volume 3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:27 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:27 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 1073741824 Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968cdb99-c85c-4a96-a61b-e8a90a1e9ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df0800-a335-4269-8394-e6362f68bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Volume volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d (dd373dc5-67f1-4363-804c-4c77d4a4f04d): created successfully Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7df0800-a335-4269-8394-e6362f68bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Flow 'volume_create_manager' (680e7396-f395-4931-8dc0-8773d517f81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c2099124-c72f-4534-a7e8-d6f49a266d11 tempest-VolumesListAdminTestJSON-24210814 None] Created volume successfully. Sep 08 19:22:28 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 1073741824" returned: 0 in 0.514s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:28 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 Sep 08 19:22:28 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:28 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c95ff1-c8e7-4dce-9266-5b126c7e5140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e535fa-f25f-4e28-9890-e8b9aa31f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:28 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Volume volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 (3dc80bd0-03f2-4c97-8cab-cdb4bebfd639): created successfully Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21e535fa-f25f-4e28-9890-e8b9aa31f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Flow 'volume_create_manager' (83b52e39-958a-4cdc-89b5-9f918e90530b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-edfd8039-8830-4594-b428-44f60caf5c43 tempest-VolumesListTestJSON-1965680811 None] Created volume successfully. Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Flow 'volume_create_manager' (0a6a3409-8d52-4bad-9908-766d72d6d425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35fbf47-cff1-4cd8-bf6e-610f660e2ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35fbf47-cff1-4cd8-bf6e-610f660e2ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7405d80e-d3aa-4911-a4e8-4432c25a1e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86104554649546e2a9269ee9897bf78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:29Z,use_quota=True,user_id='3ce31d2cd6814f5b8bc60eb38985827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba1d4e-70d1-4ea0-bac8-91ad968a9df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ba1d4e-70d1-4ea0-bac8-91ad968a9df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b252ab1-ff34-44aa-9447-005672a24721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b252ab1-ff34-44aa-9447-005672a24721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7405d80e-d3aa-4911-a4e8-4432c25a1e76', 'volume_name': 'volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c7b431-e996-4148-a3c2-086d1d2f988d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1c7b431-e996-4148-a3c2-086d1d2f988d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcb25c2-7c81-44a7-9b1a-c3b78d430c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Volume 7405d80e-d3aa-4911-a4e8-4432c25a1e76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76', 'volume_size': 1} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7405d80e-d3aa-4911-a4e8-4432c25a1e76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86104554649546e2a9269ee9897bf78b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:29Z,use_quota=True,user_id='3ce31d2cd6814f5b8bc60eb38985827d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Creating volume 7405d80e-d3aa-4911-a4e8-4432c25a1e76 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:29 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:29 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 1073741824 Sep 08 19:22:29 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (2724b280-3d6a-4b2a-82c1-154ccbafdadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc2f85a-5db6-4ae3-b7a5-ec3a80e3d779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc2f85a-5db6-4ae3-b7a5-ec3a80e3d779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698212685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:30Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c4c67fe-1bd1-4800-adf4-7a825b62f17e),volume_type_id=2c4c67fe-1bd1-4800-adf4-7a825b62f17e)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d5455f-57ac-42e4-b6e3-ced3cb7c1a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d5455f-57ac-42e4-b6e3-ced3cb7c1a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb9db3-f997-4684-98d6-a59aa74c1a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bb9db3-f997-4684-98d6-a59aa74c1a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4', 'volume_name': 'volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3696e5a-7d7e-4a86-a19d-8461879f5341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3696e5a-7d7e-4a86-a19d-8461879f5341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b16c24-10d4-41f7-92c9-6213244a8101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:29 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Volume fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4', 'volume_size': 1} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:29 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 1073741824" returned: 0 in 0.529s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:29 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 Sep 08 19:22:29 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (4f34f8be-427f-43b3-ad7f-b21bf149b062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2776c63-aa8e-4cb3-8047-e2db14151ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2776c63-aa8e-4cb3-8047-e2db14151ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933471655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9520c48-8966-4aea-86e5-fb07b15a4a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:30Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(992dd0dc-98e5-4be0-afc4-e19cab368ea7),volume_type_id=992dd0dc-98e5-4be0-afc4-e19cab368ea7)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134754a-b054-46d0-82d7-1fe2b09780b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b134754a-b054-46d0-82d7-1fe2b09780b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be03a1d-87c8-4ef3-bb76-375af2a44c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2be03a1d-87c8-4ef3-bb76-375af2a44c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9520c48-8966-4aea-86e5-fb07b15a4a16', 'volume_name': 'volume-a9520c48-8966-4aea-86e5-fb07b15a4a16', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb92e65-e73b-444a-b8fd-d5c8d9c24ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb92e65-e73b-444a-b8fd-d5c8d9c24ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a910f6b-c33c-41cb-ac7f-b59c4dad7009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume a9520c48-8966-4aea-86e5-fb07b15a4a16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9520c48-8966-4aea-86e5-fb07b15a4a16', 'volume_size': 1} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:30 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76" returned: 0 in 0.378s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-698212685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:30Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c4c67fe-1bd1-4800-adf4-7a825b62f17e),volume_type_id=2c4c67fe-1bd1-4800-adf4-7a825b62f17e)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Creating volume fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcb25c2-7c81-44a7-9b1a-c3b78d430c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e88eed-399d-4127-a56c-f9908a7e34b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:30 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 1073741824 Sep 08 19:22:30 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Volume volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 (7405d80e-d3aa-4911-a4e8-4432c25a1e76): created successfully Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e88eed-399d-4127-a56c-f9908a7e34b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Flow 'volume_create_manager' (0a6a3409-8d52-4bad-9908-766d72d6d425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2be36a6c-4623-4125-a147-6cbe4ff5d600 tempest-VolumesListAdminTestJSON-106092781 None] Created volume successfully. Sep 08 19:22:30 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 1073741824" returned: 0 in 0.574s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:30 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 Sep 08 19:22:30 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (5c5c3991-bae5-4a52-92aa-9787699ad4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d318145-a7e3-42c3-9af8-12aa7ae4aa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d318145-a7e3-42c3-9af8-12aa7ae4aa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1848623690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311c1d06-b7b6-46fe-9812-f390c111873b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:31Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd4aa50-0643-4d11-963a-93375c08978c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd4aa50-0643-4d11-963a-93375c08978c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5cc049-973d-424f-8967-636e2fc92cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5cc049-973d-424f-8967-636e2fc92cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311c1d06-b7b6-46fe-9812-f390c111873b', 'volume_name': 'volume-311c1d06-b7b6-46fe-9812-f390c111873b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e97c61-b614-457d-a8f9-1feefd80da22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e97c61-b614-457d-a8f9-1feefd80da22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc989bcd-0e53-4290-bd00-51ef91c7ab4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Volume 311c1d06-b7b6-46fe-9812-f390c111873b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311c1d06-b7b6-46fe-9812-f390c111873b', 'volume_size': 1} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (27bf7cd9-eee4-4823-a07e-705b555e8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68dfd54-b7f4-423e-8897-0e4dd43a3866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c68dfd54-b7f4-423e-8897-0e4dd43a3866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340423046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c83821-ef90-4ee8-9a17-c934f9f67ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:31Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(328695e3-ce34-4a93-96c7-c7a456324d39),volume_type_id=328695e3-ce34-4a93-96c7-c7a456324d39)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aaf57c-2b3f-4862-92a8-1ba1590fe11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12aaf57c-2b3f-4862-92a8-1ba1590fe11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cad8b1-fe26-42c1-8785-77fbff5dbb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.044s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-933471655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9520c48-8966-4aea-86e5-fb07b15a4a16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:30Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(992dd0dc-98e5-4be0-afc4-e19cab368ea7),volume_type_id=992dd0dc-98e5-4be0-afc4-e19cab368ea7)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Creating volume a9520c48-8966-4aea-86e5-fb07b15a4a16 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:31 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b16c24-10d4-41f7-92c9-6213244a8101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a54c0-49fa-4c96-999a-f971704efae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 1073741824 Sep 08 19:22:31 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Volume volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 (fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4): created successfully Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277a54c0-49fa-4c96-999a-f971704efae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (2724b280-3d6a-4b2a-82c1-154ccbafdadd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-13f7b551-0d66-4840-bf6d-7f82d5793c0b tempest-TestInstancesWithCinderVolumes-285341942 None] Created volume successfully. Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Acquiring lock "cinder-7405d80e-d3aa-4911-a4e8-4432c25a1e76-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "cinder-7405d80e-d3aa-4911-a4e8-4432c25a1e76-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Acquiring lock "cinder-quobyte-7405d80e-d3aa-4911-a4e8-4432c25a1e76" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "cinder-quobyte-7405d80e-d3aa-4911-a4e8-4432c25a1e76" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7b8c3e-d8a4-4213-a7f2-a314850e63ee]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-dd373dc5-67f1-4363-804c-4c77d4a4f04d-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-dd373dc5-67f1-4363-804c-4c77d4a4f04d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-quobyte-dd373dc5-67f1-4363-804c-4c77d4a4f04d" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-dd373dc5-67f1-4363-804c-4c77d4a4f04d" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:31 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 Sep 08 19:22:31 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[06deb0c4-47a4-40e2-991f-04adddf332c0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cad8b1-fe26-42c1-8785-77fbff5dbb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53c83821-ef90-4ee8-9a17-c934f9f67ddb', 'volume_name': 'volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb', 'volume_size': 1, 'image_id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--829505306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80c3a13c14e64175830110b20ad3dcd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'created_at': datetime.datetime(2026, 9, 8, 17, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b312d682-c060-49d5-975b-3dd2387d9737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b312d682-c060-49d5-975b-3dd2387d9737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000905b0-9b30-49f0-b7eb-3195e40acf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb', 'volume_size': 1, 'image_id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--829505306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80c3a13c14e64175830110b20ad3dcd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'created_at': datetime.datetime(2026, 9, 8, 17, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c/file', 'properties': {}}, 'image_service': } Sep 08 19:22:31 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Trying to clone 53c83821-ef90-4ee8-9a17-c934f9f67ddb from image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:22:32 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d Sep 08 19:22:32 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 1073741824" returned: 0 in 0.809s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 Sep 08 19:22:32 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76 Sep 08 19:22:32 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:32 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d" returned: 0 in 0.593s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:32 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16" returned: 0 in 0.311s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:32 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1848623690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311c1d06-b7b6-46fe-9812-f390c111873b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:31Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Creating volume 311c1d06-b7b6-46fe-9812-f390c111873b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:32 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b 1073741824 Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a910f6b-c33c-41cb-ac7f-b59c4dad7009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9520c48-8966-4aea-86e5-fb07b15a4a16', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:32 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb41f57-4c6b-4295-bedb-97e1ba4d2617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:32 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7405d80e-d3aa-4911-a4e8-4432c25a1e76" returned: 0 in 0.374s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-quobyte-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "cinder-quobyte-7405d80e-d3aa-4911-a4e8-4432c25a1e76" released by "delete_volume" :: held 0.941s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 (a9520c48-8966-4aea-86e5-fb07b15a4a16): created successfully Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb41f57-4c6b-4295-bedb-97e1ba4d2617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (4f34f8be-427f-43b3-ad7f-b21bf149b062) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" acquired by "delete_volume" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:32 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fbfa21e4-1de1-42d2-827f-ba16dc2188f3 tempest-TestInstancesWithCinderVolumes-285341942 None] Created volume successfully. Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d304a9dd-8d32-4399-b596-ef838c76242e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Created reservations ['aca51323-f5b3-426a-8b04-63750d6e76f3', '5dd260d3-d600-47c3-811b-2bb02b433dcb', 'f08b1e9c-3d22-4ebd-a040-ffc77c119aa8', '749589ba-396e-438f-9aa9-625f2b7809b2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:32 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd373dc5-67f1-4363-804c-4c77d4a4f04d" returned: 0 in 0.341s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-dd373dc5-67f1-4363-804c-4c77d4a4f04d" released by "delete_volume" :: held 0.993s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:32 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:32 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:32 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Created reservations ['750e4738-b072-44c2-b797-d964d7f75b07', 'bcde7cb4-5bc1-4c93-8a73-48ea8f33756d', 'b5602348-c045-434a-9a07-f767be3c5ee6', '11382961-0e97-41fc-8f06-6c8ede0fdf87'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:33 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:33 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:33 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b 1073741824" returned: 0 in 0.675s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" returned: 0 in 0.565s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:33 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639 Sep 08 19:22:33 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.437s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Deleted volume successfully. Sep 08 19:22:33 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b Sep 08 19:22:33 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7100b6d-be23-4ced-adac-dd7c66bebff6 tempest-VolumesListAdminTestJSON-106092781 None] Lock "cinder-7405d80e-d3aa-4911-a4e8-4432c25a1e76-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:33 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.306s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Deleted volume successfully. Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4ee4b3d8-9d75-430c-936e-670d6ed71f08 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-dd373dc5-67f1-4363-804c-4c77d4a4f04d-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:33 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" returned: 0 in 0.284s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639" released by "delete_volume" :: held 0.913s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:33 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b" returned: 0 in 0.349s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Created reservations ['f0a6e545-e90a-47a9-b406-f709698c252a', 'b16fddd2-fa92-4e87-9b1b-68258badab7a', '9d8eea1f-3ff5-4cc2-89b0-fb4c6170ebe0', '98cd34b7-66a8-41cc-a9ae-8ac30e6bd54d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc989bcd-0e53-4290-bd00-51ef91c7ab4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311c1d06-b7b6-46fe-9812-f390c111873b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ca5c46-946d-441d-828a-b4feedf931f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:33 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Volume volume-311c1d06-b7b6-46fe-9812-f390c111873b (311c1d06-b7b6-46fe-9812-f390c111873b): created successfully Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ca5c46-946d-441d-828a-b4feedf931f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (5c5c3991-bae5-4a52-92aa-9787699ad4c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5d2759e4-14aa-46ea-a604-b8e362c7f03a tempest-AttachVolumeNegativeTest-442823591 None] Created volume successfully. Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:33 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:33 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:34 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.249s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Deleted volume successfully. Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-22136cf8-f2db-4afe-a473-3b9e1f7d084a tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-3dc80bd0-03f2-4c97-8cab-cdb4bebfd639-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-0921a8f2-983c-4402-9dba-613455c574f2-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-0921a8f2-983c-4402-9dba-613455c574f2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-quobyte-0921a8f2-983c-4402-9dba-613455c574f2" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-0921a8f2-983c-4402-9dba-613455c574f2" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9803f177-0991-491f-9a49-62ae0fe39606]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:34 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 Sep 08 19:22:34 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:34 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2" returned: 0 in 0.435s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:34 devstack sudo[96894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2 Sep 08 19:22:34 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:35 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0921a8f2-983c-4402-9dba-613455c574f2" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-0921a8f2-983c-4402-9dba-613455c574f2" released by "delete_volume" :: held 0.882s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=145,cinder:DELETE=10,cinder:SELECT=105,cinder:INSERT=35 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=113,cinder:INSERT=43,cinder:UPDATE=149,cinder:DELETE=17 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-254d9f07-2874-4a1b-8048-2c702a6ee2cc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-254d9f07-2874-4a1b-8048-2c702a6ee2cc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Created reservations ['82de4bdf-abfa-468e-91e8-77143bbf6a0b', 'ab1dad60-1168-4e0d-bc29-49749017e422', '29150cde-f19e-4119-8cfa-9c29648df975', 'a80ff6c1-e051-4faa-ad57-82729d9d81d2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-quobyte-254d9f07-2874-4a1b-8048-2c702a6ee2cc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-254d9f07-2874-4a1b-8048-2c702a6ee2cc" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73014b2-c2a0-445d-a7c0-6a7c6e7037d8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ceb95632-86b2-4df0-a864-c54ad60e966c req-f766a535-5353-4682-86e7-c8b3b1a32566 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ceb95632-86b2-4df0-a864-c54ad60e966c req-f766a535-5353-4682-86e7-c8b3b1a32566 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-ceb95632-86b2-4df0-a864-c54ad60e966c req-f766a535-5353-4682-86e7-c8b3b1a32566 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:35 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:35 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-ceb95632-86b2-4df0-a864-c54ad60e966c req-f766a535-5353-4682-86e7-c8b3b1a32566 tempest-AttachVolumeNegativeTest-442823591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-311c1d06-b7b6-46fe-9812-f390c111873b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfb8716-caba-4ccd-ac86-91e87f851cb8', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:22:35 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc Sep 08 19:22:35 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-ceb95632-86b2-4df0-a864-c54ad60e966c req-f766a535-5353-4682-86e7-c8b3b1a32566 tempest-AttachVolumeNegativeTest-442823591 None] attachment_update completed successfully. Sep 08 19:22:35 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Deleted volume successfully. Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-692a9d50-8d08-4a09-8d31-dde94170f5e6 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-0921a8f2-983c-4402-9dba-613455c574f2-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:35 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc" returned: 0 in 0.456s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:35 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc Sep 08 19:22:35 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:36 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-254d9f07-2874-4a1b-8048-2c702a6ee2cc" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-254d9f07-2874-4a1b-8048-2c702a6ee2cc" released by "delete_volume" :: held 0.795s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Created reservations ['5dbc8644-0462-44be-afeb-fb1b27370646', 'f102ee1c-a3b4-4f9d-bc6c-af7a1e4a248c', '77c25da1-22be-4af2-9660-5d1c55305cf1', '81325b13-c534-4553-8290-085e1294a34d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:36 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:36 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "cinder-quobyte-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa287a6-b3f2-4047-82df-192b03bf6ac8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:36 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Deleted volume successfully. Sep 08 19:22:36 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da Sep 08 19:22:36 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-93018e4e-c22d-4847-bea4-9c30e9a55581 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-254d9f07-2874-4a1b-8048-2c702a6ee2cc-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:36 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:36 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da Sep 08 19:22:36 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:37 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-quobyte-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da" released by "delete_volume" :: held 0.675s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Created reservations ['218f2cb5-f634-49a5-8410-c01624c84328', 'f82e2d63-18dd-4431-9331-0080a9939bb1', '1c96c918-922b-434a-b19d-9b3a294283a7', '342cb62c-f9d9-41a8-bd27-e36ce331a797'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:37 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:37 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "cinder-quobyte-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2dcbc5-5487-4b0d-bc86-4b79f98ca8a3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:37 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD, size 20.69 MB, duration 5.79 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:22:37 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Image download 20.69 MB at 3.57 MB/s Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Deleted volume successfully. Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e63d8464-0863-4995-8b10-098c6e50de88 tempest-VolumesListAdminTestJSON-24210814 None] Lock "cinder-1a87bdd3-87c4-4ba8-97dd-8ae0ef7000da-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:37 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 Sep 08 19:22:37 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[203695e5-77a2-455e-bf10-9be85e0dc025]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:38 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD Sep 08 19:22:38 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:38 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" returned: 0 in 0.457s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:38 devstack sudo[97326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05 Sep 08 19:22:38 devstack sudo[97326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:38 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Temporary image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c is fetched for user 535097cc1c9c406ba30210405d552dfa. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db93f06-f55b-42e1-95d2-ff8a6956bdf8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:38 devstack sudo[97326]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" returned: 0 in 0.328s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-quobyte-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05" released by "delete_volume" :: held 0.859s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:38 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD Sep 08 19:22:38 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Created reservations ['8be829c6-18f6-46c2-853d-e29aaa4a81d4', 'd8792669-c13c-4ca6-8626-717f2d60f6fc', 'c4eca67a-b203-43e2-b1fd-6db2b01665d2', '57ca154d-a36f-474b-939e-40ab67a9854c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:38 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:38 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:38 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340423046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c83821-ef90-4ee8-9a17-c934f9f67ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c3a13c14e64175830110b20ad3dcd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:31Z,use_quota=True,user_id='535097cc1c9c406ba30210405d552dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(328695e3-ce34-4a93-96c7-c7a456324d39),volume_type_id=328695e3-ce34-4a93-96c7-c7a456324d39)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Creating volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:38 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:39 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1073741824 Sep 08 19:22:39 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:39 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.400s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Deleted volume successfully. Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c325ede4-551c-400c-9f7e-856e114ccc25 tempest-VolumesListTestJSON-1965680811 None] Lock "cinder-6c4b1a1e-97bc-4ae6-a2af-d3b36991de05-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:39 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1073741824" returned: 0 in 0.565s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:39 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb Sep 08 19:22:39 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:39 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Attempting download of ff2cfa8e-7fd6-483d-ad65-3b5f1158179c ((None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}])) to volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[63126089-f09d-4250-b041-4384fd9af669]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:40 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig Sep 08 19:22:40 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:40 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig" returned: 0 in 0.486s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:40 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig Sep 08 19:22:40 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:40 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig" returned: 1 in 0.384s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_8xug1dig' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c211a6f-39fc-4ef2-b35b-1cb54dd0cad7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:40 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD Sep 08 19:22:40 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:41 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD" returned: 0 in 0.424s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:41 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] ff2cfa8e-7fd6-483d-ad65-3b5f1158179c was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:22:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:41 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb Sep 08 19:22:41 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:43 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb" returned: 0 in 2.572s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:43 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff2cfa8e-7fd6-483d-ad65-3b5f1158179c_ch6hez8fdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:22:43 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Converted 112.00 MB image at 43.52 MB/s Sep 08 19:22:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:43 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1G Sep 08 19:22:43 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:44 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb 1G" returned: 0 in 0.568s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Downloaded image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c ((None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}])) to volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Temporary image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c for user 535097cc1c9c406ba30210405d552dfa is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Marking volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Copying metadata from image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c to 53c83821-ef90-4ee8-9a17-c934f9f67ddb. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Creating volume glance metadata for volume 53c83821-ef90-4ee8-9a17-c934f9f67ddb backed by image ff2cfa8e-7fd6-483d-ad65-3b5f1158179c with: {'image_id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'image_name': 'tempest-scenario-img--829505306', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000905b0-9b30-49f0-b7eb-3195e40acf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb', 'volume_size': 1, 'image_id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--829505306', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '80c3a13c14e64175830110b20ad3dcd6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ff2cfa8e-7fd6-483d-ad65-3b5f1158179c', 'created_at': datetime.datetime(2026, 9, 8, 17, 22, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 22, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff2cfa8e-7fd6-483d-ad65-3b5f1158179c/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf86fc9-21c2-4448-a878-cda7e0401f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Volume volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb (53c83821-ef90-4ee8-9a17-c934f9f67ddb): created successfully Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf86fc9-21c2-4448-a878-cda7e0401f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Flow 'volume_create_manager' (27bf7cd9-eee4-4823-a07e-705b555e8600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-99b35941-59a9-4515-9143-659ebcb54d91 tempest-TestInstancesWithCinderVolumes-285341942 None] Created volume successfully. Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Flow 'volume_create_manager' (a58b619c-9792-4f55-835b-e88627163df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3962ae13-5d6a-4cb8-95ac-2679323812a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3962ae13-5d6a-4cb8-95ac-2679323812a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1650191780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b5fd8-74ed-4c51-b41c-81fc91676fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7d9f85771e4d28a484249802da9477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:46Z,use_quota=True,user_id='c827576fafe84951a10b8c3960354afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c634905-341e-4324-9a29-875290aec02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c634905-341e-4324-9a29-875290aec02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fb7436-c4cf-4e39-b31e-713ccb877241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fb7436-c4cf-4e39-b31e-713ccb877241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004b5fd8-74ed-4c51-b41c-81fc91676fb8', 'volume_name': 'volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0a6b67-78e6-4422-8a47-da8d2213042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a0a6b67-78e6-4422-8a47-da8d2213042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b02f77-c708-4a8d-a2e9-0b65c98dbde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Volume 004b5fd8-74ed-4c51-b41c-81fc91676fb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8', 'volume_size': 1} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1650191780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004b5fd8-74ed-4c51-b41c-81fc91676fb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7d9f85771e4d28a484249802da9477',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:22:46Z,use_quota=True,user_id='c827576fafe84951a10b8c3960354afa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Creating volume 004b5fd8-74ed-4c51-b41c-81fc91676fb8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:22:46 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:22:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:46 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 1073741824 Sep 08 19:22:46 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 1073741824" returned: 0 in 0.643s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:47 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:47 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 Sep 08 19:22:47 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:47 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8" returned: 0 in 0.556s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] <== create_volume: return (1273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b02f77-c708-4a8d-a2e9-0b65c98dbde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524396ef-adf7-495a-8e3e-625f21e08b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:22:47 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Volume volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 (004b5fd8-74ed-4c51-b41c-81fc91676fb8): created successfully Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524396ef-adf7-495a-8e3e-625f21e08b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:22:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Flow 'volume_create_manager' (a58b619c-9792-4f55-835b-e88627163df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:22:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-13aefe4c-c29b-40ce-a97c-13bbdc2e9b39 tempest-AbsoluteLimitsTests-120580736 None] Created volume successfully. Sep 08 19:22:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Acquiring lock "cinder-004b5fd8-74ed-4c51-b41c-81fc91676fb8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "cinder-004b5fd8-74ed-4c51-b41c-81fc91676fb8-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Acquiring lock "cinder-quobyte-004b5fd8-74ed-4c51-b41c-81fc91676fb8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "cinder-quobyte-004b5fd8-74ed-4c51-b41c-81fc91676fb8" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43ddf7a-6cc5-4336-bac3-c008faa19f92]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:49 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 Sep 08 19:22:49 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:49 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8" returned: 0 in 0.704s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:49 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8 Sep 08 19:22:49 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-448b9292-a579-4e78-8291-425f0d3cb008 req-3111b642-cd3c-4016-b79f-74a778d91dd6 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-448b9292-a579-4e78-8291-425f0d3cb008 req-3111b642-cd3c-4016-b79f-74a778d91dd6 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-448b9292-a579-4e78-8291-425f0d3cb008 req-3111b642-cd3c-4016-b79f-74a778d91dd6 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-448b9292-a579-4e78-8291-425f0d3cb008 req-3111b642-cd3c-4016-b79f-74a778d91dd6 tempest-TestInstancesWithCinderVolumes-285341942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b96ca667-b90d-4cb3-a3e7-0c8efb19ea3b', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:22:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-448b9292-a579-4e78-8291-425f0d3cb008 req-3111b642-cd3c-4016-b79f-74a778d91dd6 tempest-TestInstancesWithCinderVolumes-285341942 None] attachment_update completed successfully. Sep 08 19:22:50 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-004b5fd8-74ed-4c51-b41c-81fc91676fb8" returned: 0 in 0.647s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "cinder-quobyte-004b5fd8-74ed-4c51-b41c-81fc91676fb8" released by "delete_volume" :: held 1.447s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Created reservations ['34d8b966-d8cd-4b57-8094-2135ba3729e8', 'ed7ca9b0-5736-497d-9eff-72116897be89', '31783046-f450-405d-b6dd-f33269df6c12', '7f16204f-8c3c-41db-9c5c-85c8f5cf8ecd'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:22:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:22:50 devstack sudo[97485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:22:50 devstack sudo[97485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:22:51 devstack sudo[97485]: pam_unix(sudo:session): session closed for user root Sep 08 19:22:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.412s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:22:51 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:22:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Deleted volume successfully. Sep 08 19:22:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d841bc9d-fecd-4b27-9184-8de820db7fa8 tempest-AbsoluteLimitsTests-120580736 None] Lock "cinder-004b5fd8-74ed-4c51-b41c-81fc91676fb8-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:00 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=48,cinder:INSERT=17,cinder:UPDATE=54,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:01 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=41,cinder:UPDATE=45,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Flow 'volume_create_manager' (6db3a79b-b864-4a30-b242-2b65809ed324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe195b2-eb39-4c6c-bfb3-34d7958daffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe195b2-eb39-4c6c-bfb3-34d7958daffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-770850396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19894630-6b96-4fbe-8cbc-cf58c7dc607b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec6ee3a6b9545d68cc10c298c2eb018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:05Z,use_quota=True,user_id='eeb2cccdb80d47cd962207eeec795a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfd8ab-3ca9-4407-970a-09fc1def2281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67cfd8ab-3ca9-4407-970a-09fc1def2281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5d16c-96bd-4c58-ac3b-16cb27f5b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b5d16c-96bd-4c58-ac3b-16cb27f5b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19894630-6b96-4fbe-8cbc-cf58c7dc607b', 'volume_name': 'volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c8cea4-43e7-446b-87a2-4d4f8a2a17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9c8cea4-43e7-446b-87a2-4d4f8a2a17c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696ce0b-ab36-4393-bc88-75f529d22d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:04 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Volume 19894630-6b96-4fbe-8cbc-cf58c7dc607b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b', 'volume_size': 1} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-770850396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19894630-6b96-4fbe-8cbc-cf58c7dc607b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec6ee3a6b9545d68cc10c298c2eb018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:05Z,use_quota=True,user_id='eeb2cccdb80d47cd962207eeec795a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Creating volume 19894630-6b96-4fbe-8cbc-cf58c7dc607b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:23:04 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:23:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:04 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b 1073741824 Sep 08 19:23:04 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:05 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b 1073741824" returned: 0 in 0.878s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:05 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b Sep 08 19:23:05 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:06 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b" returned: 0 in 0.330s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] <== create_volume: return (1283ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7696ce0b-ab36-4393-bc88-75f529d22d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c322f8f-b2c9-406a-a726-8dcc6793d46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Volume volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b (19894630-6b96-4fbe-8cbc-cf58c7dc607b): created successfully Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c322f8f-b2c9-406a-a726-8dcc6793d46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Flow 'volume_create_manager' (6db3a79b-b864-4a30-b242-2b65809ed324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5db7ebd2-f146-401e-933e-6d75aa8c5f7f tempest-VolumesTransfersTest-1917505570 None] Created volume successfully. Sep 08 19:23:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9748566a-d112-46ce-9c7b-e33cd2e4420f tempest-VolumesTransfersTest-1013076384 None] Transfer volume completed successfully. Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Acquiring lock "cinder-19894630-6b96-4fbe-8cbc-cf58c7dc607b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "cinder-19894630-6b96-4fbe-8cbc-cf58c7dc607b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Acquiring lock "cinder-quobyte-19894630-6b96-4fbe-8cbc-cf58c7dc607b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "cinder-quobyte-19894630-6b96-4fbe-8cbc-cf58c7dc607b" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8abcab-b199-43e7-bd08-9d055d4a710f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:09 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b Sep 08 19:23:09 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:09 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b" returned: 0 in 0.528s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:09 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b Sep 08 19:23:09 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:10 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-19894630-6b96-4fbe-8cbc-cf58c7dc607b" returned: 0 in 0.457s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "cinder-quobyte-19894630-6b96-4fbe-8cbc-cf58c7dc607b" released by "delete_volume" :: held 1.057s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Created reservations ['bab99bdb-944c-44db-bb33-a37763c7fed9', 'f4550dfe-2d1a-49a4-ae32-9a89c884156f', '3a2c9594-1b94-4823-8756-1ab66301cf35', '7a5af38d-3fa2-47dd-9cca-33a9dca1cb7d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:10 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:23:10 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:10 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.467s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:10 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:23:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Deleted volume successfully. Sep 08 19:23:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa326bbc-d2fc-4b76-b695-3a02e73303da tempest-VolumesTransfersTest-90392030 None] Lock "cinder-19894630-6b96-4fbe-8cbc-cf58c7dc607b-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Flow 'volume_create_manager' (0a615faa-dcad-4c89-b1b5-30ec7c899942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313d3782-f49c-4943-a6da-ea5fad464466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (313d3782-f49c-4943-a6da-ea5fad464466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1307215862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deaa541-b3f2-40ee-9db6-a1d2a3568bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec6ee3a6b9545d68cc10c298c2eb018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:12Z,use_quota=True,user_id='eeb2cccdb80d47cd962207eeec795a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240087c-21af-4d6f-9005-83db2502c80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2240087c-21af-4d6f-9005-83db2502c80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6608f5b3-2bc7-4b72-bd13-527e9ed76570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6608f5b3-2bc7-4b72-bd13-527e9ed76570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4deaa541-b3f2-40ee-9db6-a1d2a3568bcf', 'volume_name': 'volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38750c9-7819-4273-a97d-2bc4b5a0efef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e38750c9-7819-4273-a97d-2bc4b5a0efef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3176b9fb-e057-42ad-bd1a-6ae029655f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:12 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Volume 4deaa541-b3f2-40ee-9db6-a1d2a3568bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf', 'volume_size': 1} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1307215862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deaa541-b3f2-40ee-9db6-a1d2a3568bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec6ee3a6b9545d68cc10c298c2eb018',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:12Z,use_quota=True,user_id='eeb2cccdb80d47cd962207eeec795a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Creating volume 4deaa541-b3f2-40ee-9db6-a1d2a3568bcf {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:23:12 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:23:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:12 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf 1073741824 Sep 08 19:23:12 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:13 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf 1073741824" returned: 0 in 0.682s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:13 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf Sep 08 19:23:13 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:13 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" returned: 0 in 0.358s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3176b9fb-e057-42ad-bd1a-6ae029655f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb1de96-a5bf-47cc-be3a-865219f159aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:13 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Volume volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf (4deaa541-b3f2-40ee-9db6-a1d2a3568bcf): created successfully Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feb1de96-a5bf-47cc-be3a-865219f159aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Flow 'volume_create_manager' (0a615faa-dcad-4c89-b1b5-30ec7c899942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4f8de036-d2c2-48dc-aee7-e4384d5a4070 tempest-VolumesTransfersTest-1917505570 None] Created volume successfully. Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Acquiring lock "cinder-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "cinder-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:15 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:23:15 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Acquiring lock "cinder-quobyte-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "cinder-quobyte-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ab0c79-e8c9-461b-9a5e-f44388ba6da2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:15 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.417s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:23:15 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf Sep 08 19:23:15 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:23:15 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" returned: 0 in 0.668s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:15 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf Sep 08 19:23:15 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:16 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" returned: 0 in 0.497s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "cinder-quobyte-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf" released by "delete_volume" :: held 1.272s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Created reservations ['f55abc1b-e17e-4025-9df3-baba697b712b', '66f7659a-24bc-4a25-b1f9-e150418a8567', '3776e774-f580-405c-9f9d-95aa62245679', 'ee9e3628-4fe9-4baf-84e6-932adda1102c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:16 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:23:16 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:17 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.457s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:17 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:23:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Deleted volume successfully. Sep 08 19:23:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8f144eb0-0f94-4f3f-aa25-30368a8d0381 tempest-VolumesTransfersTest-90392030 None] Lock "cinder-4deaa541-b3f2-40ee-9db6-a1d2a3568bcf-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Flow 'volume_create_manager' (bfd70154-15cb-4010-a4aa-23c826f4eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060d0bd-0546-40b8-a13d-7f6442166296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060d0bd-0546-40b8-a13d-7f6442166296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-990061456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122bf552-5b08-4759-9b51-e431c3349126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbbfd8d931d4303b0dc05bf8434f9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:20Z,use_quota=True,user_id='8adfe045cac444f0a944fe1134395469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0447878-fc5c-4ecb-bc96-0eaa595e4ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0447878-fc5c-4ecb-bc96-0eaa595e4ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e46401-3e28-42a0-943b-e6936df9e904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e46401-3e28-42a0-943b-e6936df9e904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '122bf552-5b08-4759-9b51-e431c3349126', 'volume_name': 'volume-122bf552-5b08-4759-9b51-e431c3349126', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e83e969-19a5-483f-b87a-4444881d9d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e83e969-19a5-483f-b87a-4444881d9d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ff3267-3ce8-46a9-83af-4c0d9b5c2039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:20 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Volume 122bf552-5b08-4759-9b51-e431c3349126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-122bf552-5b08-4759-9b51-e431c3349126', 'volume_size': 1} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-990061456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=122bf552-5b08-4759-9b51-e431c3349126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adbbfd8d931d4303b0dc05bf8434f9fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:20Z,use_quota=True,user_id='8adfe045cac444f0a944fe1134395469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Creating volume 122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:23:20 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:20 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 1073741824 Sep 08 19:23:20 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:20 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 1073741824" returned: 0 in 0.462s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:20 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:20 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:21 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1ff3267-3ce8-46a9-83af-4c0d9b5c2039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-122bf552-5b08-4759-9b51-e431c3349126', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b04de3b-f38b-4984-b3b5-1864173d699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Volume volume-122bf552-5b08-4759-9b51-e431c3349126 (122bf552-5b08-4759-9b51-e431c3349126): created successfully Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b04de3b-f38b-4984-b3b5-1864173d699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Flow 'volume_create_manager' (bfd70154-15cb-4010-a4aa-23c826f4eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4c10f2d6-b1ee-4491-886d-8541decce9d1 tempest-TestImageHashVerification-1217701050 None] Created volume successfully. Sep 08 19:23:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-e7165b05-f190-4f6b-9066-35bf526c0156 req-941389f5-b341-494d-b7ea-81fca387da64 tempest-AttachVolumeNegativeTest-442823591 None] Terminate volume connection completed successfully. Sep 08 19:23:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-e7165b05-f190-4f6b-9066-35bf526c0156 req-941389f5-b341-494d-b7ea-81fca387da64 tempest-AttachVolumeNegativeTest-442823591 None] Deleting attachment 6bfb8716-caba-4ccd-ac86-91e87f851cb8. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eb4f34-bb2d-4713-b86a-ea41841ffb79]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:23 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:23 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:23 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.440s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[aafa1a57-fea2-4348-85bc-bfc31cda10fd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:24 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:24 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:24 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.458s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 /opt/stack/data/cinder/conversion/122bf552-5b08-4759-9b51-e431c3349126.temp_image.f5892e67-1f62-4555-a114-5159044a4ad4npd_efcw.img {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:24 devstack sudo[97772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 /opt/stack/data/cinder/conversion/122bf552-5b08-4759-9b51-e431c3349126.temp_image.f5892e67-1f62-4555-a114-5159044a4ad4npd_efcw.img Sep 08 19:23:24 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:30 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 /opt/stack/data/cinder/conversion/122bf552-5b08-4759-9b51-e431c3349126.temp_image.f5892e67-1f62-4555-a114-5159044a4ad4npd_efcw.img" returned: 0 in 6.262s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:30 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89a3f74-579d-4e9b-8a3b-fecdd6ca03f9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:30 devstack sudo[97797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:30 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:31 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.971s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:31 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/conversion/122bf552-5b08-4759-9b51-e431c3349126.temp_image.f5892e67-1f62-4555-a114-5159044a4ad4npd_efcw.img {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:23:31 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Converted 1024.00 MB image at 163.50 MB/s Sep 08 19:23:31 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] f5892e67-1f62-4555-a114-5159044a4ad4 was raw, no need to convert to raw {{(pid=87521) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 19:23:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d90efeff-37db-48f1-9596-a15f77b61814 req-37ccca22-ab7a-4c55-85be-5078a76ddc55 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:41 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:42 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Flow 'volume_create_manager' (8b5c7c97-0813-4a2f-b7ba-8d5e1dc9cb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11432f7-4242-4aae-9a1a-bcdaa62b3b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11432f7-4242-4aae-9a1a-bcdaa62b3b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681006845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c092718-9fb3-4ba5-a6a8-14ab835f5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e10a6bbb0a469096b891ee32144ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:46Z,use_quota=True,user_id='85326a71fd7c4d46a96ce52ab534c1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77c41c-d3e8-4f1c-a5cd-c0410ecfb3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac77c41c-d3e8-4f1c-a5cd-c0410ecfb3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b635cd-81cb-440f-9260-7fafd89600c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b635cd-81cb-440f-9260-7fafd89600c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c092718-9fb3-4ba5-a6a8-14ab835f5762', 'volume_name': 'volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bcdab7-755b-44ed-b681-3c06c8df370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99bcdab7-755b-44ed-b681-3c06c8df370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ba8bd-328e-43e3-af1c-d0097bee9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762', 'volume_size': 1} Sep 08 19:23:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.022s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Uploaded volume to glance image-id: f5892e67-1f62-4555-a114-5159044a4ad4. {{(pid=87521) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d90efeff-37db-48f1-9596-a15f77b61814 req-37ccca22-ab7a-4c55-85be-5078a76ddc55 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.083s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-d90efeff-37db-48f1-9596-a15f77b61814 req-37ccca22-ab7a-4c55-85be-5078a76ddc55 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.163s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-681006845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c092718-9fb3-4ba5-a6a8-14ab835f5762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e10a6bbb0a469096b891ee32144ca7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:23:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:23:46Z,use_quota=True,user_id='85326a71fd7c4d46a96ce52ab534c1ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Creating volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:23:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6b02b7db-670c-43cf-a2b4-968d201001c8 tempest-TestImageHashVerification-1217701050 None] Copy volume to image completed successfully. Sep 08 19:23:56 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 1073741824 Sep 08 19:23:56 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-d90efeff-37db-48f1-9596-a15f77b61814 req-37ccca22-ab7a-4c55-85be-5078a76ddc55 tempest-TestInstancesWithCinderVolumes-285341942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee67b09f-536f-449d-833c-c2ab7d28beb6', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:23:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-d90efeff-37db-48f1-9596-a15f77b61814 req-37ccca22-ab7a-4c55-85be-5078a76ddc55 tempest-TestInstancesWithCinderVolumes-285341942 None] attachment_update completed successfully. Sep 08 19:23:56 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 1073741824" returned: 0 in 0.516s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:57 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:23:57 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:57 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (871ba8bd-328e-43e3-af1c-d0097bee9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2290a-d869-434f-b165-d9822964f804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:23:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Volume volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 (1c092718-9fb3-4ba5-a6a8-14ab835f5762): created successfully Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c2290a-d869-434f-b165-d9822964f804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:23:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Flow 'volume_create_manager' (8b5c7c97-0813-4a2f-b7ba-8d5e1dc9cb0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:23:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-39874322-2855-486d-b821-88db69d50f77 tempest-VolumesActionsTest-1308903503 None] Created volume successfully. Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "cinder-122bf552-5b08-4759-9b51-e431c3349126-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "cinder-122bf552-5b08-4759-9b51-e431c3349126-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "cinder-quobyte-122bf552-5b08-4759-9b51-e431c3349126" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "cinder-quobyte-122bf552-5b08-4759-9b51-e431c3349126" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[638b8904-e901-4a59-8cd0-62ff48cbe8e7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:58 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:58 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:58 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:58 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126 Sep 08 19:23:58 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:58 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-122bf552-5b08-4759-9b51-e431c3349126" returned: 0 in 0.296s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "cinder-quobyte-122bf552-5b08-4759-9b51-e431c3349126" released by "delete_volume" :: held 0.751s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:58 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Created reservations ['624b4221-cb54-491c-ac29-18608b5aaf1c', 'c8123cd7-9a1d-4f4f-96e4-a7eed2289b04', '96fbc996-8811-46d5-98e0-ab6479dc933a', '8e047f5a-42e4-4f2f-9d03-21a498ba2687'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:23:59 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:23:59 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89b8cdf3-c517-494e-8977-1fb5f269ffbf req-845f32be-b595-4f8e-8cc7-5840cec6a53e tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89b8cdf3-c517-494e-8977-1fb5f269ffbf req-845f32be-b595-4f8e-8cc7-5840cec6a53e tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89b8cdf3-c517-494e-8977-1fb5f269ffbf req-845f32be-b595-4f8e-8cc7-5840cec6a53e tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:23:59 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.316s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:23:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Deleted volume successfully. Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-89b8cdf3-c517-494e-8977-1fb5f269ffbf req-845f32be-b595-4f8e-8cc7-5840cec6a53e tempest-TestInstancesWithCinderVolumes-285341942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-a9520c48-8966-4aea-86e5-fb07b15a4a16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8553a4f2-2cd2-406a-b3f4-c60b1a721642', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:23:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-031de975-c447-4bac-a12a-5f4f46e43208 tempest-TestImageHashVerification-1217701050 None] Lock "cinder-122bf552-5b08-4759-9b51-e431c3349126-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:23:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-89b8cdf3-c517-494e-8977-1fb5f269ffbf req-845f32be-b595-4f8e-8cc7-5840cec6a53e tempest-TestInstancesWithCinderVolumes-285341942 None] attachment_update completed successfully. Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (9cf9840d-5fe4-42e7-87f9-e96c33141f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da0b1db-c2d3-4aca-bb83-b3c5545c5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da0b1db-c2d3-4aca-bb83-b3c5545c5855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-356996998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25553832-0ad5-4d15-997e-a30585860228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:07Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52713f29-350c-4cff-8f59-bb3997660ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52713f29-350c-4cff-8f59-bb3997660ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f3ef3c-94f1-4794-8c0f-a6656e139424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f3ef3c-94f1-4794-8c0f-a6656e139424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25553832-0ad5-4d15-997e-a30585860228', 'volume_name': 'volume-25553832-0ad5-4d15-997e-a30585860228', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fe3faa-46eb-4948-9893-98b1d9b222c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8fe3faa-46eb-4948-9893-98b1d9b222c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5495a580-91f5-46c6-85d6-ce195f5544ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Volume 25553832-0ad5-4d15-997e-a30585860228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25553832-0ad5-4d15-997e-a30585860228', 'volume_size': 1} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-356996998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25553832-0ad5-4d15-997e-a30585860228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:07Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Creating volume 25553832-0ad5-4d15-997e-a30585860228 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:24:07 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:07 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 1073741824 Sep 08 19:24:07 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-f9c5aa35-bf77-472c-b89e-476f0521e0ed req-25fb06e1-c552-43ec-afe7-c3f737475d0e tempest-TestInstancesWithCinderVolumes-285341942 None] Terminate volume connection completed successfully. Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-f9c5aa35-bf77-472c-b89e-476f0521e0ed req-25fb06e1-c552-43ec-afe7-c3f737475d0e tempest-TestInstancesWithCinderVolumes-285341942 None] Deleting attachment ee67b09f-536f-449d-833c-c2ab7d28beb6. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:24:07 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 1073741824" returned: 0 in 0.760s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:07 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 Sep 08 19:24:07 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7729c0e1-1ed8-44db-9356-85f10e7d58a7 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" by "attach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7729c0e1-1ed8-44db-9356-85f10e7d58a7 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" acquired by "attach_volume" :: waited 0.047s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-quobyte-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" acquired by "delete_volume" :: waited 0.068s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55b5625-431d-4254-b476-c91e4e761c77]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7729c0e1-1ed8-44db-9356-85f10e7d58a7 tempest-VolumesActionsTest-1308903503 None] Attaching volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762 to instance beb4cd9d-3bb3-4a77-848a-b48a1fd6be6b at mountpoint /dev/vdb on host None. Sep 08 19:24:08 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228" returned: 0 in 0.436s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7729c0e1-1ed8-44db-9356-85f10e7d58a7 tempest-VolumesActionsTest-1308903503 None] Attach volume completed successfully. Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5495a580-91f5-46c6-85d6-ce195f5544ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25553832-0ad5-4d15-997e-a30585860228', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe868f42-70d6-4cc8-9c38-83f622cfe303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7729c0e1-1ed8-44db-9356-85f10e7d58a7 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" released by "attach_volume" :: held 0.290s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:08 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 Sep 08 19:24:08 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Volume volume-25553832-0ad5-4d15-997e-a30585860228 (25553832-0ad5-4d15-997e-a30585860228): created successfully Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe868f42-70d6-4cc8-9c38-83f622cfe303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (9cf9840d-5fe4-42e7-87f9-e96c33141f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1fb319cf-921f-4b73-b059-c3d37f96ff57 tempest-AttachVolumeNegativeTest-442823591 None] Created volume successfully. Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-71e8340a-9562-48db-8d2e-90cc699d5502 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" by "detach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-71e8340a-9562-48db-8d2e-90cc699d5502 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-71e8340a-9562-48db-8d2e-90cc699d5502 tempest-VolumesActionsTest-1308903503 None] Detaching volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762 from instance beb4cd9d-3bb3-4a77-848a-b48a1fd6be6b. Sep 08 19:24:08 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" returned: 0 in 0.601s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:08 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4 Sep 08 19:24:08 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-71e8340a-9562-48db-8d2e-90cc699d5502 tempest-VolumesActionsTest-1308903503 None] Detach volume completed successfully. Sep 08 19:24:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-71e8340a-9562-48db-8d2e-90cc699d5502 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:09 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4" released by "delete_volume" :: held 1.061s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:09 devstack cinder-volume[87521]: WARNING cinder.quota [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255566610-1488666388 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255566610-1488666388, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:09 devstack cinder-volume[87521]: WARNING cinder.quota [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255566610-1488666388 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-255566610-1488666388, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Created reservations ['4dfd2622-64e8-4173-841c-c79ed2af9040', 'db304b5e-58e8-4a9d-9f50-97787c8d614c', '5ba82bb8-3598-4d76-b072-44cb391ecb3e', 'ff988c52-b20c-4390-9371-58c128f9bebf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:09 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:24:09 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:09 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.495s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:09 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:24:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Deleted volume successfully. Sep 08 19:24:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-194ffdc0-aa04-4260-9670-73deec31da66 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-fc42aa7c-cea1-4ce2-b7fd-1ba399e7fdb4-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b20d5f86-d776-41c2-8a1e-e347b5b32309 req-e8c2b35d-f9f0-4c0d-a460-2055e9ba2fb2 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b20d5f86-d776-41c2-8a1e-e347b5b32309 req-e8c2b35d-f9f0-4c0d-a460-2055e9ba2fb2 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b20d5f86-d776-41c2-8a1e-e347b5b32309 req-e8c2b35d-f9f0-4c0d-a460-2055e9ba2fb2 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-b20d5f86-d776-41c2-8a1e-e347b5b32309 req-e8c2b35d-f9f0-4c0d-a460-2055e9ba2fb2 tempest-AttachVolumeNegativeTest-442823591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-25553832-0ad5-4d15-997e-a30585860228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25af3e3f-ba5b-49f6-a48a-53cbf21185eb', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:24:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-b20d5f86-d776-41c2-8a1e-e347b5b32309 req-e8c2b35d-f9f0-4c0d-a460-2055e9ba2fb2 tempest-AttachVolumeNegativeTest-442823591 None] attachment_update completed successfully. Sep 08 19:24:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-1640d7c3-1031-46ff-82e4-c18c0be08018 req-9ee85f28-046c-41fa-816e-c2c6e53d7a9d tempest-TestInstancesWithCinderVolumes-285341942 None] Terminate volume connection completed successfully. Sep 08 19:24:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-1640d7c3-1031-46ff-82e4-c18c0be08018 req-9ee85f28-046c-41fa-816e-c2c6e53d7a9d tempest-TestInstancesWithCinderVolumes-285341942 None] Deleting attachment 8553a4f2-2cd2-406a-b3f4-c60b1a721642. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:24:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-9a3f28a7-1373-45b8-868f-0c9ec3503b95 req-a4c83289-3e85-44ef-be1c-520125ef04df tempest-AttachVolumeNegativeTest-442823591 None] Terminate volume connection completed successfully. Sep 08 19:24:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-9a3f28a7-1373-45b8-868f-0c9ec3503b95 req-a4c83289-3e85-44ef-be1c-520125ef04df tempest-AttachVolumeNegativeTest-442823591 None] Deleting attachment 25af3e3f-ba5b-49f6-a48a-53cbf21185eb. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-a9520c48-8966-4aea-86e5-fb07b15a4a16-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-a9520c48-8966-4aea-86e5-fb07b15a4a16-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-quobyte-a9520c48-8966-4aea-86e5-fb07b15a4a16" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-a9520c48-8966-4aea-86e5-fb07b15a4a16" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd1c129-4f46-4780-8ade-9afbf5a4f827]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:14 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 Sep 08 19:24:14 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:15 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:24:15 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:15 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16" returned: 0 in 0.650s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:15 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16 Sep 08 19:24:15 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:15 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:15 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.746s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a9520c48-8966-4aea-86e5-fb07b15a4a16" returned: 0 in 0.619s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-a9520c48-8966-4aea-86e5-fb07b15a4a16" released by "delete_volume" :: held 1.345s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:15 devstack cinder-volume[87521]: WARNING cinder.quota [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1135742612-706952596 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1135742612-706952596, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:15 devstack cinder-volume[87521]: WARNING cinder.quota [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1135742612-706952596 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1135742612-706952596, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Created reservations ['39cd8214-9ecb-432b-85ad-09bb87828848', '3ab92cab-8b00-4e3d-b976-3225b77a7c19', 'cdd5ab7b-1abe-4a6c-9395-5c423eb7fefd', '272315a3-524a-4e08-a84f-c55d1815a6e5'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:16 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:24:16 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:16 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:16 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:24:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Deleted volume successfully. Sep 08 19:24:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90202c50-eb71-4d35-a12f-9c145ac68a17 tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-a9520c48-8966-4aea-86e5-fb07b15a4a16-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-a5b312d1-d5aa-4964-b1d5-c15c9338b131 req-dd3083e4-9a58-4378-8add-4b3531e6243c tempest-TestInstancesWithCinderVolumes-285341942 None] Terminate volume connection completed successfully. Sep 08 19:24:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-a5b312d1-d5aa-4964-b1d5-c15c9338b131 req-dd3083e4-9a58-4378-8add-4b3531e6243c tempest-TestInstancesWithCinderVolumes-285341942 None] Deleting attachment b96ca667-b90d-4cb3-a3e7-0c8efb19ea3b. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-53c83821-ef90-4ee8-9a17-c934f9f67ddb-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-53c83821-ef90-4ee8-9a17-c934f9f67ddb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "cinder-quobyte-53c83821-ef90-4ee8-9a17-c934f9f67ddb" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-53c83821-ef90-4ee8-9a17-c934f9f67ddb" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[245150a3-68fa-4932-b067-4eafb011b006]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:23 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb Sep 08 19:24:23 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:23 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb" returned: 0 in 0.458s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:24 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb Sep 08 19:24:24 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:24 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53c83821-ef90-4ee8-9a17-c934f9f67ddb" returned: 0 in 0.565s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-quobyte-53c83821-ef90-4ee8-9a17-c934f9f67ddb" released by "delete_volume" :: held 1.107s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:24 devstack cinder-volume[87521]: WARNING cinder.quota [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-565938245-1116605380 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-565938245-1116605380, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:24 devstack cinder-volume[87521]: WARNING cinder.quota [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-565938245-1116605380 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-565938245-1116605380, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Created reservations ['e0c77097-ef17-4449-990b-a4690750c4a4', '59d07881-73b9-4a12-b0cb-7b85ce2853a8', '52b39f63-4561-4115-a2f1-0ee6348664c9', '32057006-9003-4db8-960b-a8a51834a92a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:24 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:24:24 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:25 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.405s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:25 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:24:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Deleted volume successfully. Sep 08 19:24:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9438fb05-a40f-497c-93a7-a6fe50434b6d tempest-TestInstancesWithCinderVolumes-285341942 None] Lock "cinder-53c83821-ef90-4ee8-9a17-c934f9f67ddb-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f7b70ac-42c7-4d25-b92d-6a68619b5d37 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" by "attach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f7b70ac-42c7-4d25-b92d-6a68619b5d37 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" acquired by "attach_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:26 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3f7b70ac-42c7-4d25-b92d-6a68619b5d37 tempest-VolumesActionsTest-1308903503 None] Attaching volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762 to instance f610c95e-e538-4e7e-ae78-653a40bbc9a7 at mountpoint /dev/vdb on host None. Sep 08 19:24:26 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3f7b70ac-42c7-4d25-b92d-6a68619b5d37 tempest-VolumesActionsTest-1308903503 None] Attach volume completed successfully. Sep 08 19:24:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f7b70ac-42c7-4d25-b92d-6a68619b5d37 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762" released by "attach_volume" :: held 0.144s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Flow 'volume_create_manager' (a34162a4-8655-4e44-846e-04167ff66852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b59e3-ba3f-47a8-bcc4-24d7dc0ce474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b59e3-ba3f-47a8-bcc4-24d7dc0ce474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b654025-7745-4542-b4cd-9b6d4299e557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82aa971d7d14f14950032d93e33d5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:27Z,use_quota=True,user_id='ff2409d80b9d4fbab355876fa5844c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc7ba65-966a-46fc-9565-f6407fc965eb),volume_type_id=3dc7ba65-966a-46fc-9565-f6407fc965eb)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bda724-3e74-4147-bff1-2b8310e34ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2bda724-3e74-4147-bff1-2b8310e34ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5874355-8bfc-483c-a2af-6755e24c1982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d5107b8a-673d-4262-af20-07112574a1af tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" by "detach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d5107b8a-673d-4262-af20-07112574a1af tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d5107b8a-673d-4262-af20-07112574a1af tempest-VolumesActionsTest-1308903503 None] Detaching volume 1c092718-9fb3-4ba5-a6a8-14ab835f5762 from instance f610c95e-e538-4e7e-ae78-653a40bbc9a7. Sep 08 19:24:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d5107b8a-673d-4262-af20-07112574a1af tempest-VolumesActionsTest-1308903503 None] Detach volume completed successfully. Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5874355-8bfc-483c-a2af-6755e24c1982) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7b654025-7745-4542-b4cd-9b6d4299e557', 'volume_name': 'volume-7b654025-7745-4542-b4cd-9b6d4299e557', 'volume_size': 1, 'image_id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '779293b041c7a03ffa81105a1e2b6e35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c82aa971d7d14f14950032d93e33d5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eaa4f12347bb2d37b7dc5fa53086ecf3b8f26c8cb913bd748e1150bbcb9bcef8113a8d055a0597386c52f29030ea17c23b8abc0901d58767d3e49e8390dad45', 'id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'created_at': datetime.datetime(2026, 9, 8, 17, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01076889-a784-4ca6-b05a-0bc4fc155999/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894b5c33-dee1-4f14-aa81-bd0ccab8acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894b5c33-dee1-4f14-aa81-bd0ccab8acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57585582-3eee-4d21-8139-99e211a0f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Volume 7b654025-7745-4542-b4cd-9b6d4299e557: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7b654025-7745-4542-b4cd-9b6d4299e557', 'volume_size': 1, 'image_id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '779293b041c7a03ffa81105a1e2b6e35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c82aa971d7d14f14950032d93e33d5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eaa4f12347bb2d37b7dc5fa53086ecf3b8f26c8cb913bd748e1150bbcb9bcef8113a8d055a0597386c52f29030ea17c23b8abc0901d58767d3e49e8390dad45', 'id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'created_at': datetime.datetime(2026, 9, 8, 17, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01076889-a784-4ca6-b05a-0bc4fc155999/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Trying to clone 7b654025-7745-4542-b4cd-9b6d4299e557 from image 01076889-a784-4ca6-b05a-0bc4fc155999 at location (None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:24:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d5107b8a-673d-4262-af20-07112574a1af tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:28 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:24:28 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:24:28 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cac51a1-edbb-4eed-b759-c2525629a281]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:28 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:28 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:28 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 0 in 0.481s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:28 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:28 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:29 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 1 in 0.644s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:24:29 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Temporary image 01076889-a784-4ca6-b05a-0bc4fc155999 is fetched for user ff2409d80b9d4fbab355876fa5844c1f. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:24:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690d943-209f-46f2-bbf4-1d12e30347e9]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:29 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:29 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:30 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 0 in 0.588s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:30 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:30 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:30 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 1 in 0.472s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b654025-7745-4542-b4cd-9b6d4299e557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c82aa971d7d14f14950032d93e33d5c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:27Z,use_quota=True,user_id='ff2409d80b9d4fbab355876fa5844c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3dc7ba65-966a-46fc-9565-f6407fc965eb),volume_type_id=3dc7ba65-966a-46fc-9565-f6407fc965eb)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Creating volume 7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:24:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:24:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:30 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1073741824 Sep 08 19:24:30 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:31 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1073741824" returned: 0 in 0.718s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:31 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 Sep 08 19:24:31 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:31 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557" returned: 0 in 0.308s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Attempting download of 01076889-a784-4ca6-b05a-0bc4fc155999 ((None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}])) to volume 7b654025-7745-4542-b4cd-9b6d4299e557. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[33de7d4b-86ad-48bb-8b79-0b471059a268]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:31 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g Sep 08 19:24:31 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:32 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g" returned: 0 in 0.493s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:32 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g Sep 08 19:24:32 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:32 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g" returned: 1 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_01076889-a784-4ca6-b05a-0bc4fc155999_5gelnn0g' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[623f6bb8-2517-49f2-9e7e-dec0117b29bc]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:32 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:32 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:33 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:33 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD Sep 08 19:24:33 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:33 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD" returned: 1 in 0.507s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] 01076889-a784-4ca6-b05a-0bc4fc155999 was raw, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:24:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:33 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 Sep 08 19:24:33 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36475a9-1e17-4b19-a6a1-b56bb8e2238e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:34 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:24:34 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:34 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557" returned: 0 in 1.034s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_01076889-a784-4ca6-b05a-0bc4fc155999_x8h30h0udevstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:24:34 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:34 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1G Sep 08 19:24:34 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:34 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.727s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2ecf6b-6175-4bff-a3ee-c0864d1525ab]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:35 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:24:35 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:35 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 1G" returned: 0 in 0.746s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Downloaded image 01076889-a784-4ca6-b05a-0bc4fc155999 ((None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}])) to volume 7b654025-7745-4542-b4cd-9b6d4299e557 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Temporary image 01076889-a784-4ca6-b05a-0bc4fc155999 for user ff2409d80b9d4fbab355876fa5844c1f is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Marking volume 7b654025-7745-4542-b4cd-9b6d4299e557 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Copying metadata from image 01076889-a784-4ca6-b05a-0bc4fc155999 to 7b654025-7745-4542-b4cd-9b6d4299e557. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Creating volume glance metadata for volume 7b654025-7745-4542-b4cd-9b6d4299e557 backed by image 01076889-a784-4ca6-b05a-0bc4fc155999 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '779293b041c7a03ffa81105a1e2b6e35', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57585582-3eee-4d21-8139-99e211a0f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b654025-7745-4542-b4cd-9b6d4299e557', 'volume_size': 1, 'image_id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/01076889-a784-4ca6-b05a-0bc4fc155999', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '779293b041c7a03ffa81105a1e2b6e35', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c82aa971d7d14f14950032d93e33d5c4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5eaa4f12347bb2d37b7dc5fa53086ecf3b8f26c8cb913bd748e1150bbcb9bcef8113a8d055a0597386c52f29030ea17c23b8abc0901d58767d3e49e8390dad45', 'id': '01076889-a784-4ca6-b05a-0bc4fc155999', 'created_at': datetime.datetime(2026, 9, 8, 17, 24, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 24, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/01076889-a784-4ca6-b05a-0bc4fc155999/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50f4d6f-49cf-446f-b0ea-8a17842267b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Volume volume-7b654025-7745-4542-b4cd-9b6d4299e557 (7b654025-7745-4542-b4cd-9b6d4299e557): created successfully Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50f4d6f-49cf-446f-b0ea-8a17842267b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Flow 'volume_create_manager' (a34162a4-8655-4e44-846e-04167ff66852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4961fffa-28d1-40ed-9e81-440f14707273 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Created volume successfully. Sep 08 19:24:35 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.736s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.812071d8-4171-437d-bace-36904e22c8a1m9ht84ru.img {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:35 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.812071d8-4171-437d-bace-36904e22c8a1m9ht84ru.img Sep 08 19:24:35 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Acquiring lock "cinder-7b654025-7745-4542-b4cd-9b6d4299e557-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "cinder-7b654025-7745-4542-b4cd-9b6d4299e557-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Acquiring lock "cinder-quobyte-7b654025-7745-4542-b4cd-9b6d4299e557" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "cinder-quobyte-7b654025-7745-4542-b4cd-9b6d4299e557" acquired by "delete_volume" :: waited 0.037s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e3206-543f-428d-be9c-79e29bbdfa5c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:36 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 Sep 08 19:24:36 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:37 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557" returned: 0 in 1.606s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:38 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557 Sep 08 19:24:38 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:39 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7b654025-7745-4542-b4cd-9b6d4299e557" returned: 0 in 1.208s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "cinder-quobyte-7b654025-7745-4542-b4cd-9b6d4299e557" released by "delete_volume" :: held 2.984s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:39 devstack cinder-volume[87521]: WARNING cinder.quota [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:39 devstack cinder-volume[87521]: WARNING cinder.quota [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Created reservations ['9fb56d93-7782-4821-acac-df105dfcdb91', '2a7ef419-f423-40cd-be40-fc70789941ea', '3bb71d43-7141-497e-a5b2-f7484ef8819f', 'd941330a-1398-459f-a91e-ce6d751ae3db'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:24:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:39 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:24:39 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:40 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.789s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:40 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:24:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Deleted volume successfully. Sep 08 19:24:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-706c8119-25ff-4375-b5e4-757ac734a968 tempest-VolumeAndVolumeTypeFromImageTest-887377158 None] Lock "cinder-7b654025-7745-4542-b4cd-9b6d4299e557-delete_volume" released by "delete_volume" :: held 4.413s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:24:43 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.812071d8-4171-437d-bace-36904e22c8a1m9ht84ru.img" returned: 0 in 8.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:44 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[284fbc1a-c533-4b99-b4c2-b53f4855f699]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:24:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:24:44 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:24:44 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:24:44 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 08 19:24:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.820s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:24:44 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.812071d8-4171-437d-bace-36904e22c8a1m9ht84ru.img {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:24:44 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Converted 1024.00 MB image at 122.89 MB/s Sep 08 19:24:44 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] 812071d8-4171-437d-bace-36904e22c8a1 was raw, no need to convert to raw {{(pid=87521) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=72,cinder:UPDATE=63,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (419f21b7-3d0e-4039-a04d-c7c272b6e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b325f158-cfa5-4fe1-b4e2-ebbfc24af2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b325f158-cfa5-4fe1-b4e2-ebbfc24af2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095549697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75883c4b-5cfe-4516-b485-1d99c94faaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:50Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4121c9a-4c3b-43e1-9c6f-381f6d61b8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4121c9a-4c3b-43e1-9c6f-381f6d61b8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e3115c-c6bc-4b71-b819-62d4b3c567cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43e3115c-c6bc-4b71-b819-62d4b3c567cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75883c4b-5cfe-4516-b485-1d99c94faaf0', 'volume_name': 'volume-75883c4b-5cfe-4516-b485-1d99c94faaf0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bf5d69-ba87-4674-84cd-e7d078305823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0bf5d69-ba87-4674-84cd-e7d078305823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0594fb8-b790-4459-9069-19302fb813bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Volume 75883c4b-5cfe-4516-b485-1d99c94faaf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75883c4b-5cfe-4516-b485-1d99c94faaf0', 'volume_size': 1} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (010b9372-fa30-4632-beff-69fa5cd3fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f70cd4-7c59-4e29-9ec9-efe2a52530a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f70cd4-7c59-4e29-9ec9-efe2a52530a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017878654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820e60d9-6529-4d38-8ad8-22204fd9a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:51Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2306389a-fa00-4825-81dc-0d2680b7a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2306389a-fa00-4825-81dc-0d2680b7a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419639d6-5045-4fd2-a466-b8e363dfc4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419639d6-5045-4fd2-a466-b8e363dfc4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820e60d9-6529-4d38-8ad8-22204fd9a3f1', 'volume_name': 'volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad2fb78-214d-4628-822a-63b2a19695ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad2fb78-214d-4628-822a-63b2a19695ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bda496-ab35-4710-b910-3d571c36a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Volume 820e60d9-6529-4d38-8ad8-22204fd9a3f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1', 'volume_size': 1} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (30c8c490-0793-49a6-a0b1-afaf8fa38776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb8078e-4fb9-4e29-b94a-9efd989efc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb8078e-4fb9-4e29-b94a-9efd989efc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-839752220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237a942-3acd-4f96-a83c-f6ec2c18b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a16ea-bd81-41d3-aac0-c380f1f9c3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977a16ea-bd81-41d3-aac0-c380f1f9c3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29b8a7c-f039-415b-9a0d-6abd4c0db978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a29b8a7c-f039-415b-9a0d-6abd4c0db978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a237a942-3acd-4f96-a83c-f6ec2c18b269', 'volume_name': 'volume-a237a942-3acd-4f96-a83c-f6ec2c18b269', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7769b1c-be2a-4ab3-83f8-2ca46617f2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7769b1c-be2a-4ab3-83f8-2ca46617f2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2d4942-72b1-4df9-8f6b-389766956e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Volume a237a942-3acd-4f96-a83c-f6ec2c18b269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a237a942-3acd-4f96-a83c-f6ec2c18b269', 'volume_size': 1} Sep 08 19:24:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (a94cd03c-08d1-4f0b-8b62-942772c6e8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8153ad7-6787-4962-a445-b4ba3e841d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8153ad7-6787-4962-a445-b4ba3e841d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875050217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84412c23-8004-4cb9-a3d6-73169a97edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b120c34-66be-44eb-80d6-a657a4156129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b120c34-66be-44eb-80d6-a657a4156129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2ffdb2-c016-4a1c-a796-e8d9c00680af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae2ffdb2-c016-4a1c-a796-e8d9c00680af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84412c23-8004-4cb9-a3d6-73169a97edad', 'volume_name': 'volume-84412c23-8004-4cb9-a3d6-73169a97edad', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cb859e-e925-4526-ada2-c0c4f780c07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19cb859e-e925-4526-ada2-c0c4f780c07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a06e5-9781-4f44-91e9-edb2e6feb701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Volume 84412c23-8004-4cb9-a3d6-73169a97edad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84412c23-8004-4cb9-a3d6-73169a97edad', 'volume_size': 1} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (9f43ad13-9b05-4ae1-af7e-8720ed977d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d843ae84-661f-47c6-90aa-2f5847f3b43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d843ae84-661f-47c6-90aa-2f5847f3b43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696933834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3bf397-dfb8-474e-962f-d424fe50216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b572671-c4a0-4d58-a665-c2c9dfe6c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b572671-c4a0-4d58-a665-c2c9dfe6c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ef8f07-836e-452f-b2ce-6d55216cf0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0ef8f07-836e-452f-b2ce-6d55216cf0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3bf397-dfb8-474e-962f-d424fe50216a', 'volume_name': 'volume-ae3bf397-dfb8-474e-962f-d424fe50216a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c05d51b-eeb5-4e51-8a0e-8976a6d58bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c05d51b-eeb5-4e51-8a0e-8976a6d58bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7373b72a-7b96-4efb-b09f-5a6dd38ee32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Volume ae3bf397-dfb8-474e-962f-d424fe50216a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3bf397-dfb8-474e-962f-d424fe50216a', 'volume_size': 1} Sep 08 19:24:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:24:58 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=82,cinder:UPDATE=62,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:24:58 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (c0561c06-fb46-4862-8137-0b05e3dc3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216f2da6-4795-4316-a65b-bed6dc663cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (216f2da6-4795-4316-a65b-bed6dc663cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550278477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac5935c-45bf-4a44-9650-5ee1b3834d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:59Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844bf97b-1432-4c7e-92af-f1d868c4ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844bf97b-1432-4c7e-92af-f1d868c4ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b8cd82-ed34-479a-be2b-f9af062926a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b8cd82-ed34-479a-be2b-f9af062926a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac5935c-45bf-4a44-9650-5ee1b3834d1f', 'volume_name': 'volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317bc45-1666-4bde-9c8e-d8672b9d8338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5317bc45-1666-4bde-9c8e-d8672b9d8338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65b77a-7d85-462b-9a54-c973f63c4a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:24:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Volume 4ac5935c-45bf-4a44-9650-5ee1b3834d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f', 'volume_size': 1} Sep 08 19:24:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 35.342s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Uploaded volume to glance image-id: 812071d8-4171-437d-bace-36904e22c8a1. {{(pid=87521) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.781s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1095549697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75883c4b-5cfe-4516-b485-1d99c94faaf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:50Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Creating volume 75883c4b-5cfe-4516-b485-1d99c94faaf0 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:09 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:09 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 1073741824 Sep 08 19:25:09 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-57b30a42-f3b0-41d5-87c1-e7807e419e56 tempest-VolumesActionsTest-1308903503 None] Copy volume to image completed successfully. Sep 08 19:25:10 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 1073741824" returned: 0 in 0.666s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:10 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 Sep 08 19:25:10 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:10 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0" returned: 0 in 0.374s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.468s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017878654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820e60d9-6529-4d38-8ad8-22204fd9a3f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:51Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Creating volume 820e60d9-6529-4d38-8ad8-22204fd9a3f1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:10 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:10 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 1073741824 Sep 08 19:25:10 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0594fb8-b790-4459-9069-19302fb813bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75883c4b-5cfe-4516-b485-1d99c94faaf0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a15e3bc-546c-4fab-8786-6e7d1a7531c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Volume volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 (75883c4b-5cfe-4516-b485-1d99c94faaf0): created successfully Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a15e3bc-546c-4fab-8786-6e7d1a7531c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (419f21b7-3d0e-4039-a04d-c7c272b6e52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b6bac814-7186-4f94-9e67-f30ed657d3ad tempest-CreateVolumesFromImageTest-108326848 None] Created volume successfully. Sep 08 19:25:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:11 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 1073741824" returned: 0 in 0.676s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:11 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 Sep 08 19:25:11 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:11 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.699s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-839752220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237a942-3acd-4f96-a83c-f6ec2c18b269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Creating volume a237a942-3acd-4f96-a83c-f6ec2c18b269 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:11 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:11 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 1073741824 Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bda496-ab35-4710-b910-3d571c36a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:11 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bf0983-f61c-44e7-bb8a-5732c4eeb149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Volume volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 (820e60d9-6529-4d38-8ad8-22204fd9a3f1): created successfully Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13bf0983-f61c-44e7-bb8a-5732c4eeb149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (010b9372-fa30-4632-beff-69fa5cd3fd40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cf8d2e62-0a40-47e9-9ab5-609ef5d50d57 tempest-CreateVolumesFromImageTest-108326848 None] Created volume successfully. Sep 08 19:25:12 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 1073741824" returned: 0 in 0.519s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:12 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 Sep 08 19:25:12 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:12 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.218s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1875050217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84412c23-8004-4cb9-a3d6-73169a97edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Creating volume 84412c23-8004-4cb9-a3d6-73169a97edad {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:12 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2d4942-72b1-4df9-8f6b-389766956e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a237a942-3acd-4f96-a83c-f6ec2c18b269', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a927c-0c4c-403b-80c7-c25abeb99b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:12 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad 1073741824 Sep 08 19:25:12 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:12 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Volume volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 (a237a942-3acd-4f96-a83c-f6ec2c18b269): created successfully Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08a927c-0c4c-403b-80c7-c25abeb99b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (30c8c490-0793-49a6-a0b1-afaf8fa38776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6b396385-053b-44d1-86ff-88847b7c6621 tempest-CreateVolumesFromImageTest-108326848 None] Created volume successfully. Sep 08 19:25:12 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad 1073741824" returned: 0 in 0.473s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:12 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad Sep 08 19:25:12 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:13 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad" returned: 0 in 0.281s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.506s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-696933834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3bf397-dfb8-474e-962f-d424fe50216a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f16594e390124cafb2937293258189ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:52Z,use_quota=True,user_id='5dd12a855d1d4c269487754a4b9ed013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Creating volume ae3bf397-dfb8-474e-962f-d424fe50216a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:13 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a06e5-9781-4f44-91e9-edb2e6feb701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84412c23-8004-4cb9-a3d6-73169a97edad', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:13 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a 1073741824 Sep 08 19:25:13 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5354dc-91dd-4e3b-ad2e-a9ebd7289895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:13 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Volume volume-84412c23-8004-4cb9-a3d6-73169a97edad (84412c23-8004-4cb9-a3d6-73169a97edad): created successfully Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d5354dc-91dd-4e3b-ad2e-a9ebd7289895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (a94cd03c-08d1-4f0b-8b62-942772c6e8a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0bb3726c-c161-4e3f-9910-7bf1ee8a245e tempest-CreateVolumesFromImageTest-108326848 None] Created volume successfully. Sep 08 19:25:13 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a 1073741824" returned: 0 in 0.639s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:13 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a Sep 08 19:25:13 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:14 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.060s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-550278477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac5935c-45bf-4a44-9650-5ee1b3834d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1489a9bb3d4315960b06ea3412eab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:24:59Z,use_quota=True,user_id='aabafe4575db4678ab70ac1d4356cf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Creating volume 4ac5935c-45bf-4a44-9650-5ee1b3834d1f {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:14 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7373b72a-7b96-4efb-b09f-5a6dd38ee32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3bf397-dfb8-474e-962f-d424fe50216a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5075944-5699-4d05-9159-41511673c7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:14 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f 1073741824 Sep 08 19:25:14 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:14 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Volume volume-ae3bf397-dfb8-474e-962f-d424fe50216a (ae3bf397-dfb8-474e-962f-d424fe50216a): created successfully Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5075944-5699-4d05-9159-41511673c7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Flow 'volume_create_manager' (9f43ad13-9b05-4ae1-af7e-8720ed977d92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-02be3b4e-46b3-4e75-8060-41a71ca39362 tempest-CreateVolumesFromImageTest-108326848 None] Created volume successfully. Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-ae3bf397-dfb8-474e-962f-d424fe50216a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-ae3bf397-dfb8-474e-962f-d424fe50216a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-quobyte-ae3bf397-dfb8-474e-962f-d424fe50216a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-ae3bf397-dfb8-474e-962f-d424fe50216a" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d6a80-67e1-4951-8ce6-5380b79e0d25]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:14 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f 1073741824" returned: 0 in 0.540s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:14 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a Sep 08 19:25:14 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:14 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f Sep 08 19:25:14 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:15 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:15 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:15 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" returned: 0 in 0.293s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.229s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a" returned: 0 in 0.435s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de65b77a-7d85-462b-9a54-c973f63c4a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a553b22-be50-4f46-97da-f074c235242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:15 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a Sep 08 19:25:15 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d63573b-4252-4a73-8d4c-7f18c9ad781c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:15 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Volume volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f (4ac5935c-45bf-4a44-9650-5ee1b3834d1f): created successfully Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a553b22-be50-4f46-97da-f074c235242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Flow 'volume_create_manager' (c0561c06-fb46-4862-8137-0b05e3dc3f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fb750947-6142-4e7c-b156-b80de424284b tempest-AttachVolumeNegativeTest-442823591 None] Created volume successfully. Sep 08 19:25:15 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:25:15 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:15 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.374s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:25:15 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ae3bf397-dfb8-474e-962f-d424fe50216a" returned: 0 in 0.313s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-ae3bf397-dfb8-474e-962f-d424fe50216a" released by "delete_volume" :: held 0.792s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Created reservations ['1b6d9ef0-efab-4d7e-a413-d09a03bc9630', '5260a268-1b73-4d2b-8c3e-c38ec6ef1f03', '7d9a4e6b-b39e-4172-a0c0-e0c606431b8a', '4ffa0094-97a7-4707-8d90-31e9f6f5ad56'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:15 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:15 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:15 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.512s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a5fcb-4947-4d00-b164-21dd06f5b897]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-84412c23-8004-4cb9-a3d6-73169a97edad-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:15 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:25:15 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-84412c23-8004-4cb9-a3d6-73169a97edad-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:15 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.309s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-quobyte-84412c23-8004-4cb9-a3d6-73169a97edad" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Deleted volume successfully. Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-84412c23-8004-4cb9-a3d6-73169a97edad" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1d3d2b4-0bd5-45a0-abf7-ee2b046f839b tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-ae3bf397-dfb8-474e-962f-d424fe50216a-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a37fbb-ebca-405a-b359-39adf2e3b103]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:16 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad Sep 08 19:25:16 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:16 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.417s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:16 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img Sep 08 19:25:16 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:16 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad" returned: 0 in 0.412s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:16 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad Sep 08 19:25:16 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:16 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-84412c23-8004-4cb9-a3d6-73169a97edad" returned: 0 in 0.585s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-84412c23-8004-4cb9-a3d6-73169a97edad" released by "delete_volume" :: held 1.099s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Created reservations ['21436ef0-09c7-45b0-92ff-1aaec0d28af9', 'e0ef6b73-b931-4a79-a98e-57c05a3580c3', 'a7beba5c-9daf-455e-b4f7-701b4aca1f95', 'b414aaae-3974-428f-ae17-beb906673daa'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:17 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:17 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:18 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.745s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Deleted volume successfully. Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-a237a942-3acd-4f96-a83c-f6ec2c18b269-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-227e7dac-0207-4d8a-bf79-cf3bf1f93b93 tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-84412c23-8004-4cb9-a3d6-73169a97edad-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-a237a942-3acd-4f96-a83c-f6ec2c18b269-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89879b45-bc22-4c57-ba61-3c1d60205fea req-b5142209-0a9e-4441-8210-f6d331a3ea60 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-quobyte-a237a942-3acd-4f96-a83c-f6ec2c18b269" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-a237a942-3acd-4f96-a83c-f6ec2c18b269" acquired by "delete_volume" :: waited 0.038s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c668e-0d82-48ba-bd78-291a426cc9ef]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:19 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 Sep 08 19:25:19 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:19 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269" returned: 0 in 0.917s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:19 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269 Sep 08 19:25:19 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:20 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a237a942-3acd-4f96-a83c-f6ec2c18b269" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-a237a942-3acd-4f96-a83c-f6ec2c18b269" released by "delete_volume" :: held 1.485s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Created reservations ['811e3630-be77-4802-bc56-35775a8e233e', 'f0bc271d-0770-41e4-907e-00879f3269f6', '58434728-99b8-47cf-8f99-788f926d8fa0', '3190a514-32c0-4df9-bcd9-037d33ebb3e6'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:20 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:20 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-820e60d9-6529-4d38-8ad8-22204fd9a3f1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-820e60d9-6529-4d38-8ad8-22204fd9a3f1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-quobyte-820e60d9-6529-4d38-8ad8-22204fd9a3f1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-820e60d9-6529-4d38-8ad8-22204fd9a3f1" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b61f881-63ac-419c-b63f-9ddfedb3aeb6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:21 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.690s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Deleted volume successfully. Sep 08 19:25:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-45d9f520-fe75-4c04-903a-84e71396addd tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-a237a942-3acd-4f96-a83c-f6ec2c18b269-delete_volume" released by "delete_volume" :: held 2.812s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:21 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 Sep 08 19:25:21 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:22 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img" returned: 0 in 6.178s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c433f-9a39-415f-b08e-bb058d471352]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:22 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1" returned: 0 in 1.102s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:22 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1 Sep 08 19:25:22 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:22 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:25:22 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:22 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-820e60d9-6529-4d38-8ad8-22204fd9a3f1" returned: 0 in 0.339s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-820e60d9-6529-4d38-8ad8-22204fd9a3f1" released by "delete_volume" :: held 1.562s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Created reservations ['00a127fd-6679-4cda-b1e9-769a6cb6b7ae', '6494cf99-3a65-43e3-a47b-22fe4d921ee0', 'b72fc131-3fb3-477f-860f-d6b0cf59cc81', '1d20f10b-45f7-4845-8701-335f8760ea22'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:22 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:22 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:22 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.652s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:25:22 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Converted 1024.00 MB image at 165.73 MB/s Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] 19a1e112-56e4-4ab1-9510-e2b75045f667 was raw, converting to qcow2 {{(pid=87521) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe226cf0-95f9-47c1-b630-4d8b5756cc65]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:23 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img Sep 08 19:25:23 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:23 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:23 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Deleted volume successfully. Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeff94b8-3689-42f0-8915-9cdfdd23d30c tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-820e60d9-6529-4d38-8ad8-22204fd9a3f1-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:23 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img" returned: 0 in 0.400s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:23 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img Sep 08 19:25:23 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-75883c4b-5cfe-4516-b485-1d99c94faaf0-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-75883c4b-5cfe-4516-b485-1d99c94faaf0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:23 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img" returned: 1 in 0.358s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "cinder-quobyte-75883c4b-5cfe-4516-b485-1d99c94faaf0" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-75883c4b-5cfe-4516-b485-1d99c94faaf0" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:23 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1 Sep 08 19:25:23 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[67328ced-87e3-4104-97bd-92522a853397]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:23 devstack sudo[99287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 Sep 08 19:25:23 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:24 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Image conversion details: src /opt/stack/data/cinder/conversion/1c092718-9fb3-4ba5-a6a8-14ab835f5762.temp_image.19a1e112-56e4-4ab1-9510-e2b75045f667lh0_9jp7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:25:24 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bf0727-f675-4c9a-b72a-009ca9b18ddf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:24 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1 Sep 08 19:25:24 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:24 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0" returned: 0 in 0.410s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:24 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0 Sep 08 19:25:24 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:24 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ltzz5rc1" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:24 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75883c4b-5cfe-4516-b485-1d99c94faaf0" returned: 0 in 0.290s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-quobyte-75883c4b-5cfe-4516-b485-1d99c94faaf0" released by "delete_volume" :: held 0.755s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Created reservations ['5c0f3d24-4466-4e07-a76d-e03c2554ce06', '9bfd8c1f-ebc8-4954-a606-a3324eab54f0', 'd26c8771-11be-4c46-80c6-757bee240093', 'b2ee3fea-dcf8-4273-a5eb-26477bfcda59'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:24 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:24 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.339s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:24 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:25 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Deleted volume successfully. Sep 08 19:25:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4acfc1ff-a96b-42bb-8966-4e34862105de tempest-CreateVolumesFromImageTest-108326848 None] Lock "cinder-75883c4b-5cfe-4516-b485-1d99c94faaf0-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.067s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Uploaded volume to glance image-id: 19a1e112-56e4-4ab1-9510-e2b75045f667. {{(pid=87521) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 08 19:25:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89879b45-bc22-4c57-ba61-3c1d60205fea req-b5142209-0a9e-4441-8210-f6d331a3ea60 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.492s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-89879b45-bc22-4c57-ba61-3c1d60205fea req-b5142209-0a9e-4441-8210-f6d331a3ea60 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5b60d465-f7ad-4995-b18d-7125b65ce3eb tempest-VolumesActionsTest-1308903503 None] Copy volume to image completed successfully. Sep 08 19:25:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-89879b45-bc22-4c57-ba61-3c1d60205fea req-b5142209-0a9e-4441-8210-f6d331a3ea60 tempest-AttachVolumeNegativeTest-442823591 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e64abd6-9aa6-4332-b42f-f1eeca2b3bd1', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:25:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-89879b45-bc22-4c57-ba61-3c1d60205fea req-b5142209-0a9e-4441-8210-f6d331a3ea60 tempest-AttachVolumeNegativeTest-442823591 None] attachment_update completed successfully. Sep 08 19:25:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "cinder-quobyte-1c092718-9fb3-4ba5-a6a8-14ab835f5762" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-quobyte-1c092718-9fb3-4ba5-a6a8-14ab835f5762" acquired by "delete_volume" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[82afb912-d175-4d0e-903c-34691f299bc3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:29 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:25:29 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:29 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.711s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:29 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762 Sep 08 19:25:29 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:30 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (baa9a8f9-82be-48eb-acef-d2c9f6677b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfee34f-e1ab-4a8f-a83b-58528ef52ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c092718-9fb3-4ba5-a6a8-14ab835f5762" returned: 0 in 0.566s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-quobyte-1c092718-9fb3-4ba5-a6a8-14ab835f5762" released by "delete_volume" :: held 1.369s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfee34f-e1ab-4a8f-a83b-58528ef52ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732190913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:30Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab1a3d-7e94-4dec-812c-9a7157e5bf5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aab1a3d-7e94-4dec-812c-9a7157e5bf5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e9dde9-83d9-4958-9a89-b23ce0080dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e9dde9-83d9-4958-9a89-b23ce0080dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3', 'volume_name': 'volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed35aa4e-3877-4a91-a779-dcd9ceef3e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed35aa4e-3877-4a91-a779-dcd9ceef3e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5537bf05-3d78-43a7-8f2c-e2d35798aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3', 'volume_size': 1} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732190913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:30Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:30 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 1073741824 Sep 08 19:25:30 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-be94ead9-00bf-4c5f-bccb-0da3c2db5964 req-3ddd7d72-8d42-4dca-aa99-717051876e1a tempest-AttachVolumeNegativeTest-442823591 None] Terminate volume connection completed successfully. Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-be94ead9-00bf-4c5f-bccb-0da3c2db5964 req-3ddd7d72-8d42-4dca-aa99-717051876e1a tempest-AttachVolumeNegativeTest-442823591 None] Deleting attachment 6e64abd6-9aa6-4332-b42f-f1eeca2b3bd1. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Created reservations ['597cce12-73f1-4ec6-ae3b-d5de2c0f2b0f', '4f8f29ea-ad64-450b-8e18-e7b201ee0ebf', '06852aad-7b1e-4f54-98f8-615c71786729', '53a3e414-2af4-4db4-a76b-5840f7669f0e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:30 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:30 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:31 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.371s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Deleted volume successfully. Sep 08 19:25:31 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 1073741824" returned: 0 in 0.648s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3383d65d-7246-4a25-8abc-d8f72cfbae51 tempest-VolumesActionsTest-1308903503 None] Lock "cinder-1c092718-9fb3-4ba5-a6a8-14ab835f5762-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:31 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 Sep 08 19:25:31 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:31 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5537bf05-3d78-43a7-8f2c-e2d35798aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0659ab-c483-4cb9-9157-a16b0141c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 (aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3): created successfully Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d0659ab-c483-4cb9-9157-a16b0141c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (baa9a8f9-82be-48eb-acef-d2c9f6677b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1981a686-9698-4b8f-aedb-7a49d3b75ee5 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (b849717b-b6ed-4159-80d4-62b47feaf6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d43852-a8a7-4b56-9566-d5e1da3a8fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d43852-a8a7-4b56-9566-d5e1da3a8fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585829371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206bfb8-c443-4263-b9c1-8eb61fd2f33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:33Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655de3eb-0285-41b9-a5ee-720389ffd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (655de3eb-0285-41b9-a5ee-720389ffd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9aee28b-16df-4881-a078-eb5e32522eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9aee28b-16df-4881-a078-eb5e32522eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1206bfb8-c443-4263-b9c1-8eb61fd2f33b', 'volume_name': 'volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6450f1d2-8d04-4f16-b35f-374639ed460e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6450f1d2-8d04-4f16-b35f-374639ed460e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720b7f8-1f77-45fe-9d76-300d835b68f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:33 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume 1206bfb8-c443-4263-b9c1-8eb61fd2f33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b', 'volume_size': 1} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1585829371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1206bfb8-c443-4263-b9c1-8eb61fd2f33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:33Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume 1206bfb8-c443-4263-b9c1-8eb61fd2f33b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:33 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:33 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b 1073741824 Sep 08 19:25:33 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (9875c3fb-cf0b-4035-aa44-54c04231928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0898edda-2d5a-4a4e-9561-e23c62e33f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0898edda-2d5a-4a4e-9561-e23c62e33f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1751997535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5074fd9f-2591-4882-8110-ab50ae9e4c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:34Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1630c9e-f4e4-4258-97ce-dedd03a9f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1630c9e-f4e4-4258-97ce-dedd03a9f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec58085-7783-41cd-a014-06bfc35b78cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec58085-7783-41cd-a014-06bfc35b78cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5074fd9f-2591-4882-8110-ab50ae9e4c8b', 'volume_name': 'volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c24569-0977-464b-aa65-973d8ef13a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:34 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c24569-0977-464b-aa65-973d8ef13a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d268921-58dc-446e-ad28-19b5a0530ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:34 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume 5074fd9f-2591-4882-8110-ab50ae9e4c8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b', 'volume_size': 1} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b 1073741824" returned: 0 in 1.039s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:34 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b Sep 08 19:25:34 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (858e3ff6-0298-4b72-b266-a0ab3052cc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef2509-f229-4f1c-8a8b-cd7d3581f088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68ef2509-f229-4f1c-8a8b-cd7d3581f088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412834829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24c3541-db84-4637-a3ef-576756462a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:35Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ed5edc-2ad5-4c2c-89b5-b22d3c312401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3ed5edc-2ad5-4c2c-89b5-b22d3c312401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a69bb7-af9b-4af7-946d-d41a9beb79e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3a69bb7-af9b-4af7-946d-d41a9beb79e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24c3541-db84-4637-a3ef-576756462a80', 'volume_name': 'volume-c24c3541-db84-4637-a3ef-576756462a80', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ab1053-a37b-4994-b9b5-da33930bf6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2ab1053-a37b-4994-b9b5-da33930bf6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566c5c2-9adf-49e6-95f2-010f598f4830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume c24c3541-db84-4637-a3ef-576756462a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24c3541-db84-4637-a3ef-576756462a80', 'volume_size': 1} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" returned: 0 in 0.601s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1751997535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5074fd9f-2591-4882-8110-ab50ae9e4c8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:34Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume 5074fd9f-2591-4882-8110-ab50ae9e4c8b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:35 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:35 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b 1073741824 Sep 08 19:25:35 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a720b7f8-1f77-45fe-9d76-300d835b68f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ee9ef6-8ef6-42e9-8292-e24b4a7db380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b (1206bfb8-c443-4263-b9c1-8eb61fd2f33b): created successfully Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ee9ef6-8ef6-42e9-8292-e24b4a7db380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (b849717b-b6ed-4159-80d4-62b47feaf6a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bd9e4822-86a7-4962-9645-06b8c3343f49 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (55b72887-5c41-4e46-aeda-ed480c7e234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8e86c5-5dfc-48ff-9258-bdef9b4ab650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8e86c5-5dfc-48ff-9258-bdef9b4ab650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357615442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:36Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e521e25-071d-41d3-8e73-4a59df4a4f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e521e25-071d-41d3-8e73-4a59df4a4f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a38f9e-9644-4fda-9f85-dbfe722683c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a38f9e-9644-4fda-9f85-dbfe722683c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8', 'volume_name': 'volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a680cd-d384-464f-b992-e713322df0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a680cd-d384-464f-b992-e713322df0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d75362b-acc4-4b4b-a663-44b0e1ec3051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume 9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8', 'volume_size': 1} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:36 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b 1073741824" returned: 0 in 0.834s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:36 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b Sep 08 19:25:36 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:36 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b" returned: 0 in 0.494s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.446s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.483s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-412834829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24c3541-db84-4637-a3ef-576756462a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:35Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume c24c3541-db84-4637-a3ef-576756462a80 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:36 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:36 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 1073741824 Sep 08 19:25:36 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d268921-58dc-446e-ad28-19b5a0530ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243911e2-67b5-4e6b-a269-a27162e0e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b (5074fd9f-2591-4882-8110-ab50ae9e4c8b): created successfully Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (243911e2-67b5-4e6b-a269-a27162e0e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (9875c3fb-cf0b-4035-aa44-54c04231928e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (b86f6906-785d-4712-a1e3-120c457251ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d136e03-f9cd-48ec-bbfa-a1c8522abf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-46f43238-e1f2-4bb7-9717-cdb63ba15875 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d136e03-f9cd-48ec-bbfa-a1c8522abf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124811444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7bda45-21e8-4b7f-85df-0a00ca802890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:37Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94da8f5-68c0-4e1f-811a-5decbdbb2d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94da8f5-68c0-4e1f-811a-5decbdbb2d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c9c22b-50ba-49c3-bc49-e191110eea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c9c22b-50ba-49c3-bc49-e191110eea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7bda45-21e8-4b7f-85df-0a00ca802890', 'volume_name': 'volume-5f7bda45-21e8-4b7f-85df-0a00ca802890', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad57e4-526e-44a1-ae79-18fba015098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad57e4-526e-44a1-ae79-18fba015098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe698a-aabe-46a8-be9d-1bd834fc917d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:37 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume 5f7bda45-21e8-4b7f-85df-0a00ca802890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7bda45-21e8-4b7f-85df-0a00ca802890', 'volume_size': 1} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-4ac5935c-45bf-4a44-9650-5ee1b3834d1f-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-4ac5935c-45bf-4a44-9650-5ee1b3834d1f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:37 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 1073741824" returned: 0 in 0.583s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-quobyte-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:37 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:37 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e14166-964c-4b94-9391-07fbdd867dbd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:37 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f Sep 08 19:25:37 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:37 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80" returned: 0 in 0.438s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.783s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1357615442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:36Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume 9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:37 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:37 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 1073741824 Sep 08 19:25:37 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5566c5c2-9adf-49e6-95f2-010f598f4830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24c3541-db84-4637-a3ef-576756462a80', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3e452c-cc46-47be-8fe5-60788ecbcd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-c24c3541-db84-4637-a3ef-576756462a80 (c24c3541-db84-4637-a3ef-576756462a80): created successfully Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3e452c-cc46-47be-8fe5-60788ecbcd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (858e3ff6-0298-4b72-b266-a0ab3052cc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b185c259-e99f-4584-acdb-900ce77cbae0 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:38 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" returned: 0 in 0.606s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:38 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f Sep 08 19:25:38 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:38 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" returned: 0 in 0.333s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-4ac5935c-45bf-4a44-9650-5ee1b3834d1f" released by "delete_volume" :: held 1.004s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Created reservations ['5afeb147-d908-4587-9d4e-9072ea4787e4', '712025a2-bc12-49ef-9463-77925ac933d0', 'c1ce5dae-7205-444d-a2d4-86778be82b62', '97a0916e-b858-48cf-8108-af125d1b29a6'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:38 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 1073741824" returned: 0 in 0.673s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:38 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 Sep 08 19:25:38 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:38 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:38 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:38 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:38 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Deleted volume successfully. Sep 08 19:25:39 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" returned: 0 in 0.446s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cc65956e-dd14-4df5-8f73-3be1c75fd155 tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-4ac5935c-45bf-4a44-9650-5ee1b3834d1f-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1124811444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7bda45-21e8-4b7f-85df-0a00ca802890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db5f3e528642e998782e6577459bdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:37Z,use_quota=True,user_id='6dfc567435ce469ab38287b0338680b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Creating volume 5f7bda45-21e8-4b7f-85df-0a00ca802890 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:39 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d75362b-acc4-4b4b-a663-44b0e1ec3051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:39 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 1073741824 Sep 08 19:25:39 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ec1af2-327d-49d5-bf0b-782f474f046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:39 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 (9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8): created successfully Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ec1af2-327d-49d5-bf0b-782f474f046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (55b72887-5c41-4e46-aeda-ed480c7e234d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-31d6233c-9148-44e1-a195-996660d6d93e tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-25553832-0ad5-4d15-997e-a30585860228-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:39 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 1073741824" returned: 0 in 0.776s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-25553832-0ad5-4d15-997e-a30585860228-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:39 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 Sep 08 19:25:39 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-quobyte-25553832-0ad5-4d15-997e-a30585860228" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-25553832-0ad5-4d15-997e-a30585860228" acquired by "delete_volume" :: waited 0.043s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[22499a66-5b67-4033-9278-16126c80e34b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:40 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 Sep 08 19:25:40 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:40 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65fe698a-aabe-46a8-be9d-1bd834fc917d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7bda45-21e8-4b7f-85df-0a00ca802890', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba1f372-1210-4be5-b357-70f60966c48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:40 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Volume volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 (5f7bda45-21e8-4b7f-85df-0a00ca802890): created successfully Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ba1f372-1210-4be5-b357-70f60966c48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Flow 'volume_create_manager' (b86f6906-785d-4712-a1e3-120c457251ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-175e1406-51b9-473e-bcc2-5f2e71bab836 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created volume successfully. Sep 08 19:25:40 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228" returned: 0 in 0.470s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:40 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228 Sep 08 19:25:40 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:40 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-25553832-0ad5-4d15-997e-a30585860228" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-25553832-0ad5-4d15-997e-a30585860228" released by "delete_volume" :: held 0.806s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Created reservations ['6bd37260-47e2-4c5d-8528-c149a50c967d', '32960309-45d3-474b-bd81-2a18c91b53bd', '36523ad4-cc36-4755-8f57-a50399b422ed', '46d55cd9-8c16-4ba3-8f3e-90b536dd123e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:40 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:40 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:41 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Deleted volume successfully. Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-311c1d06-b7b6-46fe-9812-f390c111873b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-5f7bda45-21e8-4b7f-85df-0a00ca802890-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-18c03168-7100-4dd0-b427-bd575eedb72e tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-25553832-0ad5-4d15-997e-a30585860228-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-5f7bda45-21e8-4b7f-85df-0a00ca802890-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-311c1d06-b7b6-46fe-9812-f390c111873b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "cinder-quobyte-311c1d06-b7b6-46fe-9812-f390c111873b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-5f7bda45-21e8-4b7f-85df-0a00ca802890" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-311c1d06-b7b6-46fe-9812-f390c111873b" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-5f7bda45-21e8-4b7f-85df-0a00ca802890" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fca2e9-f4bb-4230-b38e-0238c3b5f0de]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[89218567-27f3-4c61-ab71-830b89c10240]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:41 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b Sep 08 19:25:41 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:41 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 Sep 08 19:25:41 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:41 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b" returned: 0 in 0.395s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:41 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890" returned: 0 in 0.407s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:41 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b Sep 08 19:25:41 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:41 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890 Sep 08 19:25:41 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:42 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-311c1d06-b7b6-46fe-9812-f390c111873b" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-quobyte-311c1d06-b7b6-46fe-9812-f390c111873b" released by "delete_volume" :: held 0.729s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:42 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5f7bda45-21e8-4b7f-85df-0a00ca802890" returned: 0 in 0.287s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-5f7bda45-21e8-4b7f-85df-0a00ca802890" released by "delete_volume" :: held 0.735s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Created reservations ['8c97c169-79f7-44ad-bed7-8bae869f9853', 'e88445c8-9477-4156-941f-b397df7bd0d7', 'a877fa26-d2e1-4f9a-9700-b61ca95785d5', 'f239016d-0380-45a3-8853-c8d391f388a1'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['12f58774-e29b-4e20-8e0e-3eddc019d553', '7067a694-347e-4e84-9265-904218fc29f2', '8889b030-c9ba-4dae-baa5-0bf851eac44b', '99c00def-c23e-42e9-a2a6-4252162fad90'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:42 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:42 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:42 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:42 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:42 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Deleted volume successfully. Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a6c318a7-4d50-4ccc-b385-92e36811931c tempest-AttachVolumeNegativeTest-442823591 None] Lock "cinder-311c1d06-b7b6-46fe-9812-f390c111873b-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5374c-f789-47fe-a55e-d877fd4d0f0c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:42 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.448s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d20809d2-bb62-4dbf-a36a-a1108f9d2c9f tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-5f7bda45-21e8-4b7f-85df-0a00ca802890-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:42 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 Sep 08 19:25:42 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:43 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:43 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8 Sep 08 19:25:43 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:43 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Flow 'volume_create_manager' (c7b5a6c9-b579-4a03-95c2-42371aeebcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d6bf7d-dd6c-4834-b88d-49d282c253bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d6bf7d-dd6c-4834-b88d-49d282c253bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1353355964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d43388-bf7a-4f0d-a923-4d365bb4ed6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178dc71433a44f59800665c2627da76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:43Z,use_quota=True,user_id='a9d9f86f00cc47fcbf9eae92a7657b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d15f3c-fe3b-447f-9aca-e8e2984a0102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d15f3c-fe3b-447f-9aca-e8e2984a0102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f85b18-5ff9-4f2b-97c0-f8f4eced44e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f85b18-5ff9-4f2b-97c0-f8f4eced44e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7d43388-bf7a-4f0d-a923-4d365bb4ed6c', 'volume_name': 'volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c', 'volume_size': 2}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f346678-051c-4ff7-8491-07a00f48c26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f346678-051c-4ff7-8491-07a00f48c26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a97245-1fc9-4d4b-9ad3-26ebe6477b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Volume b7d43388-bf7a-4f0d-a923-4d365bb4ed6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c', 'volume_size': 2} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1353355964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7d43388-bf7a-4f0d-a923-4d365bb4ed6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178dc71433a44f59800665c2627da76a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:43Z,use_quota=True,user_id='a9d9f86f00cc47fcbf9eae92a7657b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Creating volume b7d43388-bf7a-4f0d-a923-4d365bb4ed6c {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:43 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c 2147483648 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8" released by "delete_volume" :: held 0.881s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:43 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c 2147483648 Sep 08 19:25:43 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['46f104f9-177d-4f37-b419-2cea0de92860', 'e10a75c0-2084-489a-ad99-e40e5cdb45a0', 'd0eb01ce-ce9e-4017-8580-1bb36beb0cae', '983ee426-29be-4426-ae11-e1fa33c5af7e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:43 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:43 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-c24c3541-db84-4637-a3ef-576756462a80-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-c24c3541-db84-4637-a3ef-576756462a80-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-c24c3541-db84-4637-a3ef-576756462a80" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-c24c3541-db84-4637-a3ef-576756462a80" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67c5131-8ccc-4200-983e-f47a3ba2c2e3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:44 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.321s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57da3568-a608-4099-aadf-9560252a8d8d tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-9efbe9cc-97b3-4346-b9cb-6b0015fb1cb8-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:44 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 Sep 08 19:25:44 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:44 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c 2147483648" returned: 0 in 0.661s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:44 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c Sep 08 19:25:44 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:44 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80" returned: 0 in 0.449s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:44 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80 Sep 08 19:25:44 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:44 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4a97245-1fc9-4d4b-9ad3-26ebe6477b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c', 'volume_size': 2}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ea8ede-4080-416c-b68e-23418ad1318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:44 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c24c3541-db84-4637-a3ef-576756462a80" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Volume volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c (b7d43388-bf7a-4f0d-a923-4d365bb4ed6c): created successfully Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ea8ede-4080-416c-b68e-23418ad1318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Flow 'volume_create_manager' (c7b5a6c9-b579-4a03-95c2-42371aeebcdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-c24c3541-db84-4637-a3ef-576756462a80" released by "delete_volume" :: held 0.755s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-41895695-47d8-4885-b928-cf2dee4c26bd tempest-VolumesCloneNegativeTest-394816624 None] Created volume successfully. Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['3ee145aa-833d-4e4a-a763-676a7b53c8c2', '45a845a6-6b6c-4a4c-819f-94b64c1ed7fb', 'd7a73e4b-6eff-41a5-acc1-aa841d52c2c3', 'f384a13a-cc83-4f19-8726-4994b07f9543'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:44 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:44 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-5074fd9f-2591-4882-8110-ab50ae9e4c8b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-5074fd9f-2591-4882-8110-ab50ae9e4c8b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-5074fd9f-2591-4882-8110-ab50ae9e4c8b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:45 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.295s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-5074fd9f-2591-4882-8110-ab50ae9e4c8b" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[851805a1-49b8-41b8-a765-ab5b399f8a89]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3e580fcc-64b5-4e82-976d-4ec445dfeb67 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-c24c3541-db84-4637-a3ef-576756462a80-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:45 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b Sep 08 19:25:45 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:45 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b" returned: 0 in 0.447s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:45 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b Sep 08 19:25:45 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Acquiring lock "cinder-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "cinder-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Acquiring lock "cinder-quobyte-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "cinder-quobyte-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e42e6e-9eeb-4abf-9bd3-2010e184d7bf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:45 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5074fd9f-2591-4882-8110-ab50ae9e4c8b" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-5074fd9f-2591-4882-8110-ab50ae9e4c8b" released by "delete_volume" :: held 0.781s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:45 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c Sep 08 19:25:45 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:45 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['83b4145a-8c73-4b1f-a69a-1724127034c0', 'ec18024f-cd9e-4bed-80f2-0323023ded1f', '0b1315e6-8052-402e-9911-1c6efe17d267', '1d28604d-8f58-4bc8-a55f-3b26bf8b43d3'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:46 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:46 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-1206bfb8-c443-4263-b9c1-8eb61fd2f33b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:46 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-1206bfb8-c443-4263-b9c1-8eb61fd2f33b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" returned: 0 in 0.420s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:46 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c Sep 08 19:25:46 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:46 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d050e1-aff6-4478-af43-cb51f29f6368]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97f7e9fb-e379-4d13-88c0-d293502dd308 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-5074fd9f-2591-4882-8110-ab50ae9e4c8b-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:46 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b Sep 08 19:25:46 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:46 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" returned: 0 in 0.462s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "cinder-quobyte-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c" released by "delete_volume" :: held 0.929s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Created reservations ['cb9e0359-6239-4c47-8030-dd2c45e9b3e3', '4436eb04-cc14-45f1-9915-346469464207', '5f0d9ac5-9bf3-41ef-a6dc-8e358b9d506f', '711c3f26-2067-46c5-bea5-0002854c366c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:46 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:46 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:47 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" returned: 0 in 0.654s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:47 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b Sep 08 19:25:47 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:47 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Deleted volume successfully. Sep 08 19:25:47 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" returned: 0 in 0.389s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-1206bfb8-c443-4263-b9c1-8eb61fd2f33b" released by "delete_volume" :: held 1.118s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d65004dd-4c8f-4d7d-a6de-d8dacc3f08b0 tempest-VolumesCloneNegativeTest-394816624 None] Lock "cinder-b7d43388-bf7a-4f0d-a923-4d365bb4ed6c-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['9201e3ed-b735-4b94-9238-c0279510400f', 'e533e2fe-53b8-4777-aeb9-d559d155aa2d', '333144ac-95df-4872-8d98-51ba321344fc', '6caa59e4-6d66-47b7-909b-a89efa022942'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:47 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:47 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:47 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:47 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3673c7f5-1231-4c19-a1e3-3a32c7220d0c tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-1206bfb8-c443-4263-b9c1-8eb61fd2f33b-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "cinder-quobyte-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[aacd5f26-b123-4fe5-9873-69a2a3c099ac]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:48 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 Sep 08 19:25:48 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:49 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:49 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3 Sep 08 19:25:49 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:49 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" returned: 0 in 0.263s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-quobyte-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3" released by "delete_volume" :: held 0.754s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Created reservations ['dffc4ac5-3f4a-4bcc-881d-10a1a5f7c7d2', '47b515f4-00b2-405d-a103-cbfff3432957', 'ce5c8020-faca-4833-9db8-14c96eadc96e', 'da58e271-ca25-4ea1-bd90-49b03f8c15aa'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:49 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:25:49 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:49 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.369s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:25:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Deleted volume successfully. Sep 08 19:25:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d27c96ed-5396-40b6-adb0-6845b62e36d9 tempest-CreateVolumesFromSourceVolumeTest-1569588166 None] Lock "cinder-aaa8f8e9-2f8a-4cb1-80b4-0c256e2d61f3-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Flow 'volume_create_manager' (0b98f19a-fa25-40b7-a7f8-21dbddc4db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa41fea1-ec9c-4273-927e-9b9f9fba512e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa41fea1-ec9c-4273-927e-9b9f9fba512e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-120241885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3e1c3991bd42e1921db88c966c74b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:51Z,use_quota=True,user_id='400105b2e74c4dd5bb875eb6e31e620d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590805e3-e8c0-4790-a4bc-8fedd3832852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590805e3-e8c0-4790-a4bc-8fedd3832852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afd2e4-cb9f-4610-9d62-bb21479bc735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afd2e4-cb9f-4610-9d62-bb21479bc735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1', 'volume_name': 'volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0b053-31db-4922-bd31-fe8621689300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0b053-31db-4922-bd31-fe8621689300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10cb62d-eb5b-42f9-9a26-e30a7c3775e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Volume cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1', 'volume_size': 1} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-120241885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea3e1c3991bd42e1921db88c966c74b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:51Z,use_quota=True,user_id='400105b2e74c4dd5bb875eb6e31e620d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Creating volume cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:51 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 1073741824 Sep 08 19:25:51 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:51 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 1073741824" returned: 0 in 0.586s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:52 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 Sep 08 19:25:52 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:52 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" returned: 0 in 0.324s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10cb62d-eb5b-42f9-9a26-e30a7c3775e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b7b23-79ce-4087-aa7d-c1b204a60645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Volume volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 (cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1): created successfully Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87b7b23-79ce-4087-aa7d-c1b204a60645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Flow 'volume_create_manager' (0b98f19a-fa25-40b7-a7f8-21dbddc4db85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-da34c330-e5d3-4b24-9fc3-9dd229750e1b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Created volume successfully. Sep 08 19:25:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9b3d77bd-ae50-4e8b-bc88-73e2c1b0628e tempest-BackendsCapabilitiesAdminTestsJSON-583585167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4755859375, 'free_capacity_gb': 1773.4755859375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87521) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:25:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9ef39a6d-e469-4008-95a7-59abb6080d1f tempest-BackendsCapabilitiesAdminTestsJSON-583585167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4755859375, 'free_capacity_gb': 1773.4755859375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87521) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Flow 'volume_create_manager' (71d1f1f0-4304-41f4-9d73-3b724ce8320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b790d73-1ecf-43d2-945d-5dbccae45729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b790d73-1ecf-43d2-945d-5dbccae45729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a317d8c-f081-492b-a87d-c1156e8404f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e2ccb6ada4d5db34d39c0d54393fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:54Z,use_quota=True,user_id='5f40eef50a1441c084c08d9bf9183a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4041335d-eb4e-426d-8a40-35658da845a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4041335d-eb4e-426d-8a40-35658da845a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c11239-c40f-4865-843b-6e62d1fa5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c11239-c40f-4865-843b-6e62d1fa5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a317d8c-f081-492b-a87d-c1156e8404f1', 'volume_name': 'volume-3a317d8c-f081-492b-a87d-c1156e8404f1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4db008-20bd-4273-bc2a-bbcfeff41a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4db008-20bd-4273-bc2a-bbcfeff41a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b53559b-f149-4699-8396-18560d4920d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Volume 3a317d8c-f081-492b-a87d-c1156e8404f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a317d8c-f081-492b-a87d-c1156e8404f1', 'volume_size': 1} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a317d8c-f081-492b-a87d-c1156e8404f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e2ccb6ada4d5db34d39c0d54393fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:54Z,use_quota=True,user_id='5f40eef50a1441c084c08d9bf9183a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Creating volume 3a317d8c-f081-492b-a87d-c1156e8404f1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:54 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:54 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 1073741824 Sep 08 19:25:54 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Flow 'volume_create_manager' (d8a415e0-a434-4c20-b880-450bcf6ba921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca6c2a4-7a57-4a67-aa0f-a3eac5110e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-5ab6c128-ea5d-469d-bca9-11adc2af7959 req-1c959056-28f1-4af3-8f85-3dfc8cc17888 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca6c2a4-7a57-4a67-aa0f-a3eac5110e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-895809901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ee6785-1320-42b5-9ba6-739c8f57d840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe608b94d0b4132a0829eb159c2e347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:55Z,use_quota=True,user_id='5ed0385cca8346cd8f99bf6057ab07b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef4bd0e-f2d7-43ed-a098-294d338729f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef4bd0e-f2d7-43ed-a098-294d338729f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee87e4da-7c27-4658-9bde-82102304d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee87e4da-7c27-4658-9bde-82102304d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9ee6785-1320-42b5-9ba6-739c8f57d840', 'volume_name': 'volume-d9ee6785-1320-42b5-9ba6-739c8f57d840', 'volume_size': 2}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe912ce1-c842-4fcf-92fa-589052608923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe912ce1-c842-4fcf-92fa-589052608923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c586da3-53fe-4840-b019-eb6e9a09ff34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Volume d9ee6785-1320-42b5-9ba6-739c8f57d840: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9ee6785-1320-42b5-9ba6-739c8f57d840', 'volume_size': 2} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:54 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 1073741824" returned: 0 in 0.567s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:54 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 Sep 08 19:25:54 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:55 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-5ab6c128-ea5d-469d-bca9-11adc2af7959 req-1c959056-28f1-4af3-8f85-3dfc8cc17888 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.366s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b53559b-f149-4699-8396-18560d4920d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a317d8c-f081-492b-a87d-c1156e8404f1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7ad667-600d-4ec9-a5f8-87f51e330b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-5ab6c128-ea5d-469d-bca9-11adc2af7959 req-1c959056-28f1-4af3-8f85-3dfc8cc17888 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.343s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-895809901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9ee6785-1320-42b5-9ba6-739c8f57d840,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbe608b94d0b4132a0829eb159c2e347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:55Z,use_quota=True,user_id='5ed0385cca8346cd8f99bf6057ab07b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Creating volume d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:55 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 2147483648 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Volume volume-3a317d8c-f081-492b-a87d-c1156e8404f1 (3a317d8c-f081-492b-a87d-c1156e8404f1): created successfully Sep 08 19:25:55 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 2147483648 Sep 08 19:25:55 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd7ad667-600d-4ec9-a5f8-87f51e330b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Flow 'volume_create_manager' (71d1f1f0-4304-41f4-9d73-3b724ce8320d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e7b701a3-0c04-4f8a-985b-5ccb840ca429 tempest-CinderUnicodeTest-857668883 None] Created volume successfully. Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-5ab6c128-ea5d-469d-bca9-11adc2af7959 req-1c959056-28f1-4af3-8f85-3dfc8cc17888 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'affbc7cc-f1e1-4d2d-9155-a0be8ff18a93', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:25:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-5ab6c128-ea5d-469d-bca9-11adc2af7959 req-1c959056-28f1-4af3-8f85-3dfc8cc17888 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] attachment_update completed successfully. Sep 08 19:25:55 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 2147483648" returned: 0 in 0.619s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:55 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 Sep 08 19:25:55 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:56 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c586da3-53fe-4840-b019-eb6e9a09ff34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9ee6785-1320-42b5-9ba6-739c8f57d840', 'volume_size': 2}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa0626-b173-4be2-8ccb-08c5359cb6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Volume volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 (d9ee6785-1320-42b5-9ba6-739c8f57d840): created successfully Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cfa0626-b173-4be2-8ccb-08c5359cb6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Flow 'volume_create_manager' (d8a415e0-a434-4c20-b880-450bcf6ba921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5ce231a2-e917-4691-b301-ae5fe8032021 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Created volume successfully. Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Flow 'volume_create_manager' (c273307a-c13d-44dc-a7c1-250c80d67d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f44e0-8d69-4c32-8178-79282ae9bfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f44e0-8d69-4c32-8178-79282ae9bfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-448738690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ddec27-38f6-4cff-a626-52dd666795cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e2ccb6ada4d5db34d39c0d54393fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:57Z,use_quota=True,user_id='5f40eef50a1441c084c08d9bf9183a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fff70d-4c28-42af-a55b-5ded16c11363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4fff70d-4c28-42af-a55b-5ded16c11363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d8ca0-f0c8-4020-94d8-150ccf79b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d8ca0-f0c8-4020-94d8-150ccf79b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ddec27-38f6-4cff-a626-52dd666795cb', 'volume_name': 'volume-37ddec27-38f6-4cff-a626-52dd666795cb', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5fbf8-27ad-4b70-abb8-2a44f3ad878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d5fbf8-27ad-4b70-abb8-2a44f3ad878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa29af1d-55d2-4f4a-b243-5ade19df5e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Volume 37ddec27-38f6-4cff-a626-52dd666795cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ddec27-38f6-4cff-a626-52dd666795cb', 'volume_size': 1} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:25:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-448738690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37ddec27-38f6-4cff-a626-52dd666795cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187e2ccb6ada4d5db34d39c0d54393fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:25:57Z,use_quota=True,user_id='5f40eef50a1441c084c08d9bf9183a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Creating volume 37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:25:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:25:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:56 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb 1073741824 Sep 08 19:25:56 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:57 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb 1073741824" returned: 0 in 0.516s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:57 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb Sep 08 19:25:57 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:57 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb" returned: 0 in 0.262s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.577s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Creating offline snapshot 341cc048-43d2-4aae-a173-b525e90a3db5 of volume d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa29af1d-55d2-4f4a-b243-5ade19df5e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ddec27-38f6-4cff-a626-52dd666795cb', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346d3815-db78-4a4a-8d30-8a2701e197ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5de8102-2bb6-4af1-8602-cda2d81910d0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Volume volume-37ddec27-38f6-4cff-a626-52dd666795cb (37ddec27-38f6-4cff-a626-52dd666795cb): created successfully Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (346d3815-db78-4a4a-8d30-8a2701e197ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:25:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Flow 'volume_create_manager' (c273307a-c13d-44dc-a7c1-250c80d67d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:25:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d3a7ef7d-2958-4cc4-beed-81b40cc1806c tempest-CinderUnicodeTest-857668883 None] Created volume successfully. Sep 08 19:25:57 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 Sep 08 19:25:57 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:58 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840" returned: 0 in 0.450s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 2G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:58 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 2G Sep 08 19:25:58 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-04335e44-3f5c-47dc-bfa0-c648960d51fb req-9841a769-96fc-4bc6-81a2-add54f7cdb57 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Terminate volume connection completed successfully. Sep 08 19:25:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-04335e44-3f5c-47dc-bfa0-c648960d51fb req-9841a769-96fc-4bc6-81a2-add54f7cdb57 tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Deleting attachment affbc7cc-f1e1-4d2d-9155-a0be8ff18a93. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:25:58 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 2G" returned: 0 in 0.470s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:58 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 Sep 08 19:25:58 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:59 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:59 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 is being set with open permissions: ugo+rw Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:59 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 Sep 08 19:25:59 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:25:59 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5" returned: 0 in 0.296s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:59 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info Sep 08 19:25:59 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "cinder-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "cinder-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "cinder-quobyte-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "cinder-quobyte-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff32b3cf-b4b9-4169-887d-40e1a77b234e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:59 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info" returned: 0 in 0.308s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:59 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info is being set with open permissions: ugo+rw Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:25:59 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info Sep 08 19:25:59 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:59 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 Sep 08 19:25:59 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:25:59 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.info" returned: 0 in 0.272s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.828s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Creating offline snapshot d06409c1-23f0-47c3-9fd2-b221d04e2578 of volume 37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:25:59 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Sep 08 19:25:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1330c80f-fffb-444d-9c82-34a344cd9448 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Create snapshot completed successfully Sep 08 19:25:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" returned: 0 in 0.416s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dad026b-5486-4975-9ca0-9baa07750c12]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:00 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1 Sep 08 19:26:00 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:00 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb Sep 08 19:26:00 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:00 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" returned: 0 in 0.320s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "cinder-quobyte-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1" released by "delete_volume" :: held 0.794s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "cinder-341cc048-43d2-4aae-a173-b525e90a3db5-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Created reservations ['06dca871-1b41-4084-9be0-8666a3ba2409', '465c087c-99d0-4208-b519-378d6b024d8e', '422cb526-3514-449e-b431-385398f66b30', '8c3556e7-33a8-415c-8694-1ca09dbd3e75'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-341cc048-43d2-4aae-a173-b525e90a3db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:00 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb" returned: 0 in 0.461s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:00 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 1G Sep 08 19:26:00 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "cinder-quobyte-341cc048-43d2-4aae-a173-b525e90a3db5" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-341cc048-43d2-4aae-a173-b525e90a3db5" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Deleting offline snapshot 341cc048-43d2-4aae-a173-b525e90a3db5 of volume d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] snapshot_file for this snap is: volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549dc67-e790-4597-9c7b-3ddbc0bff647]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:00 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:00 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:00 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 Sep 08 19:26:00 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:01 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Deleted volume successfully. Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8ef84fcc-7087-4b3c-975d-fe50460c126b tempest-TestServerVolumeAttachScenarioOldVersion-1143944273 None] Lock "cinder-cd2bbcd3-3fdf-4c5b-a5fc-5a725c5c88c1-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:01 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5" returned: 0 in 0.542s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9ee6785-1320-42b5-9ba6-739c8f57d840(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:26:01 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 1G" returned: 0 in 0.726s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ddec27-38f6-4cff-a626-52dd666795cb -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe5935d-8e46-4ca9-be80-e94b7cc0e3f9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:01 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ddec27-38f6-4cff-a626-52dd666795cb -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 Sep 08 19:26:01 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:01 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 Sep 08 19:26:01 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:01 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ddec27-38f6-4cff-a626-52dd666795cb -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578" returned: 0 in 0.597s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:01 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 is being set with open permissions: ugo+rw Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:01 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 Sep 08 19:26:01 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:01 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840" returned: 0 in 0.635s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:01 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 Sep 08 19:26:01 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:02 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:02 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info Sep 08 19:26:02 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:02 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5" returned: 0 in 0.514s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:02 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5 Sep 08 19:26:02 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:02 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info is being set with open permissions: ugo+rw Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:02 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info Sep 08 19:26:02 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:02 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840.341cc048-43d2-4aae-a173-b525e90a3db5" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-341cc048-43d2-4aae-a173-b525e90a3db5" released by "_delete_snapshot" :: held 2.251s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" released by "delete_snapshot" :: held 2.314s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:02 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.info" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9ef702ea-17aa-4498-878b-4f37143bc1c1 tempest-CinderUnicodeTest-857668883 None] Create snapshot completed successfully Sep 08 19:26:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Created reservations ['dcfc8f35-6d3c-4cc4-8aa6-569652915077', '60966624-069a-4f01-b2cf-3c1e3e6b7c0e', '716a03f0-c282-45b8-863f-a36f85ddef75', '0b78ad72-523f-47c9-b1a8-cd423c8d05d0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Delete snapshot completed successfully. Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6c3bbd62-a589-4d7d-aeab-0c7b2020ff7b tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-341cc048-43d2-4aae-a173-b525e90a3db5-delete_snapshot" released by "delete_snapshot" :: held 2.583s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-d06409c1-23f0-47c3-9fd2-b221d04e2578-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-d06409c1-23f0-47c3-9fd2-b221d04e2578-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-quobyte-d06409c1-23f0-47c3-9fd2-b221d04e2578" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-d06409c1-23f0-47c3-9fd2-b221d04e2578" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Deleting offline snapshot d06409c1-23f0-47c3-9fd2-b221d04e2578 of volume 37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] snapshot_file for this snap is: volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e98467-3bc7-4b56-a84e-4fbbbf0df06b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:03 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 Sep 08 19:26:03 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "cinder-d9ee6785-1320-42b5-9ba6-739c8f57d840-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-d9ee6785-1320-42b5-9ba6-739c8f57d840-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:04 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578" returned: 0 in 0.515s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ddec27-38f6-4cff-a626-52dd666795cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8335c910-36bc-4aac-b40e-5f93823d579c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2bf9bc-c735-4acf-b63e-2067b563d868]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:04 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 Sep 08 19:26:04 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:04 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb Sep 08 19:26:04 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:04 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb" returned: 0 in 0.463s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:04 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840" returned: 0 in 0.513s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:04 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 Sep 08 19:26:04 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:04 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840 Sep 08 19:26:04 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:04 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d9ee6785-1320-42b5-9ba6-739c8f57d840" returned: 0 in 0.321s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-quobyte-d9ee6785-1320-42b5-9ba6-739c8f57d840" released by "delete_volume" :: held 0.931s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:05 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578" returned: 0 in 0.434s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Created reservations ['0021a16d-a11f-4cea-867b-2512752de1fe', '3558e937-30ce-4a39-8810-140e3fded956', 'f6242d85-b35e-4d52-992d-cc2809de6f3e', '2c3a670a-3f42-4095-9f6e-ce49df13c3a4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:05 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578 Sep 08 19:26:05 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:05 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:05 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:05 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb.d06409c1-23f0-47c3-9fd2-b221d04e2578" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-d06409c1-23f0-47c3-9fd2-b221d04e2578" released by "_delete_snapshot" :: held 1.937s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" released by "delete_snapshot" :: held 1.967s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Created reservations ['5906082b-30e4-408f-9392-460dfeb59caa', 'c639c4b6-1257-476b-a8c9-96a5c12bc65a', '7bdc2fc2-dcb4-4cda-b076-496fa138ef57', '46719b54-e5d7-4abc-8d24-fa1fb06d8d34'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:05 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.317s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Deleted volume successfully. Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29b6967a-c6ac-4c52-ab20-871c9aaa25b5 tempest-VolumesSnapshotNegativeTestJSON-870876956 None] Lock "cinder-d9ee6785-1320-42b5-9ba6-739c8f57d840-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Delete snapshot completed successfully. Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-98de5195-70c6-4624-adca-67d4bafdfc6e tempest-CinderUnicodeTest-857668883 None] Lock "cinder-d06409c1-23f0-47c3-9fd2-b221d04e2578-delete_snapshot" released by "delete_snapshot" :: held 2.171s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-37ddec27-38f6-4cff-a626-52dd666795cb-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-37ddec27-38f6-4cff-a626-52dd666795cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d006cd-2873-4037-b87c-7b195e5a01e0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:05 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb Sep 08 19:26:05 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:06 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb" returned: 0 in 0.450s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:06 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb Sep 08 19:26:06 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:06 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-37ddec27-38f6-4cff-a626-52dd666795cb" returned: 0 in 0.282s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-37ddec27-38f6-4cff-a626-52dd666795cb" released by "delete_volume" :: held 0.830s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Created reservations ['ebe31e4b-13e4-46bf-990f-b70623e74957', '4d14f0a1-f12f-4838-a874-34435f69f954', '37b72fc0-04ed-4adb-af6c-9e16567ee2c2', '0458be1b-4445-48c0-8e62-f0eb35023ec9'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:06 devstack sudo[100668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:06 devstack sudo[100668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-3a317d8c-f081-492b-a87d-c1156e8404f1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-3a317d8c-f081-492b-a87d-c1156e8404f1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "cinder-quobyte-3a317d8c-f081-492b-a87d-c1156e8404f1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-3a317d8c-f081-492b-a87d-c1156e8404f1" acquired by "delete_volume" :: waited 0.044s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[355a3f40-df49-4f2c-943e-f55d9944df2f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:07 devstack sudo[100668]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.456s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Deleted volume successfully. Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee42f831-684e-4144-8bac-ffa39c4d3191 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-37ddec27-38f6-4cff-a626-52dd666795cb-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:07 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 Sep 08 19:26:07 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:07 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1" returned: 0 in 0.549s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:07 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1 Sep 08 19:26:07 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:08 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3a317d8c-f081-492b-a87d-c1156e8404f1" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-quobyte-3a317d8c-f081-492b-a87d-c1156e8404f1" released by "delete_volume" :: held 0.923s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Created reservations ['c1982434-a136-4707-94d1-699b2d7207ff', '22f7c4a9-c3cb-461b-a8cb-462358e91125', '5974bea4-34c2-47e0-854f-15389d36e645', '1a7eb510-7e0c-4ac1-9377-3fdd345f7fc5'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:08 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:08 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:08 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.333s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Deleted volume successfully. Sep 08 19:26:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-309a153b-719c-4099-b287-9965dcbb6ba7 tempest-CinderUnicodeTest-857668883 None] Lock "cinder-3a317d8c-f081-492b-a87d-c1156e8404f1-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=173,cinder:UPDATE=224,cinder:DELETE=20,cinder:INSERT=44 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=230,cinder:SELECT=156,cinder:INSERT=63,cinder:DELETE=19 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (f21c2e5c-3f77-4091-a753-e3ee154f3774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ac90d-a47d-4979-8bac-a8396303d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6ac90d-a47d-4979-8bac-a8396303d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360917337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f423aa-311b-471d-83f7-a79f21d120f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:10Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4ecbba-d7c8-4ffc-9f0b-52e3a0f5a9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4ecbba-d7c8-4ffc-9f0b-52e3a0f5a9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e48090-85e0-4ffa-a419-a2daa950312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e48090-85e0-4ffa-a419-a2daa950312a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f423aa-311b-471d-83f7-a79f21d120f6', 'volume_name': 'volume-00f423aa-311b-471d-83f7-a79f21d120f6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b4ffab-b210-44dd-8845-8917a7ec19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b4ffab-b210-44dd-8845-8917a7ec19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a5babb-5f83-4d00-931c-17f9afe0c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:10 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume 00f423aa-311b-471d-83f7-a79f21d120f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f423aa-311b-471d-83f7-a79f21d120f6', 'volume_size': 1} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-360917337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f423aa-311b-471d-83f7-a79f21d120f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:10Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume 00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:10 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:10 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 1073741824 Sep 08 19:26:10 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 1073741824" returned: 0 in 0.766s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:11 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:11 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 Sep 08 19:26:11 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:11 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6" returned: 0 in 0.371s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a5babb-5f83-4d00-931c-17f9afe0c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f423aa-311b-471d-83f7-a79f21d120f6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980b086b-9006-4c73-8bdf-f7ba2fee356c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:11 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-00f423aa-311b-471d-83f7-a79f21d120f6 (00f423aa-311b-471d-83f7-a79f21d120f6): created successfully Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980b086b-9006-4c73-8bdf-f7ba2fee356c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:11 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (f21c2e5c-3f77-4091-a753-e3ee154f3774) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f5108f3c-25c4-430e-b31d-831fe6cdf720 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating offline snapshot 7b1fccb1-9b4b-420b-86ea-fc328e172f09 of volume 00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:26:12 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7440f3f-5af1-4844-92ab-c2cd25b763c0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:12 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 Sep 08 19:26:12 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:13 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6" returned: 0 in 0.444s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:13 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 1G Sep 08 19:26:13 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:13 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 1G" returned: 0 in 0.569s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f423aa-311b-471d-83f7-a79f21d120f6 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:13 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f423aa-311b-471d-83f7-a79f21d120f6 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 Sep 08 19:26:13 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:14 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f423aa-311b-471d-83f7-a79f21d120f6 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:14 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 is being set with open permissions: ugo+rw Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:14 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 Sep 08 19:26:14 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:14 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09" returned: 0 in 0.330s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:14 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info Sep 08 19:26:14 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:14 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:14 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info is being set with open permissions: ugo+rw Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:14 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info Sep 08 19:26:14 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:15 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:15 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:15 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.info" returned: 0 in 0.398s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-26229f30-bdcd-4a9f-824d-03c23afa774e tempest-CreateVolumesFromSnapshotTest-208736648 None] Create snapshot completed successfully Sep 08 19:26:15 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:26:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (7a71b237-9770-440e-b283-82345c05b67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b73c9-5518-47be-82c5-822d8a5b573b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528b73c9-5518-47be-82c5-822d8a5b573b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-771399268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848e76a4-6644-4b6b-9665-0795e93435d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:17Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5fca8c-a90f-449a-9a08-69906fa33ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f5fca8c-a90f-449a-9a08-69906fa33ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b6647-5021-487d-b647-ad7bcea715b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b6647-5021-487d-b647-ad7bcea715b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848e76a4-6644-4b6b-9665-0795e93435d7', 'volume_name': 'volume-848e76a4-6644-4b6b-9665-0795e93435d7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4820e95-8109-4cd0-8b71-574fc6046367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4820e95-8109-4cd0-8b71-574fc6046367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269d5b6e-b44f-4b33-9a1b-6504eea321ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume 848e76a4-6644-4b6b-9665-0795e93435d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848e76a4-6644-4b6b-9665-0795e93435d7', 'volume_size': 1} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-771399268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848e76a4-6644-4b6b-9665-0795e93435d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:17Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume 848e76a4-6644-4b6b-9665-0795e93435d7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:16 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:17 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 1073741824 Sep 08 19:26:17 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (a8509121-8e54-4954-9db9-b436d5642799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e8008-e7e0-435c-8335-7846e3e1a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818e8008-e7e0-435c-8335-7846e3e1a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690798693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dc0297-eead-4816-8cb5-17db65f65652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:17Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b4acb-8cd6-43d0-af05-c7a9d2c6ceed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1b4acb-8cd6-43d0-af05-c7a9d2c6ceed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138c29d2-a2d0-42a6-a463-050ad667ce5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (138c29d2-a2d0-42a6-a463-050ad667ce5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47dc0297-eead-4816-8cb5-17db65f65652', 'volume_name': 'volume-47dc0297-eead-4816-8cb5-17db65f65652', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcfa6ae-94a2-4433-a006-dee30523ff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcfa6ae-94a2-4433-a006-dee30523ff4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1fa8d5-672e-4923-9c26-d277c7d026d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume 47dc0297-eead-4816-8cb5-17db65f65652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47dc0297-eead-4816-8cb5-17db65f65652', 'volume_size': 1} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:17 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 1073741824" returned: 0 in 0.685s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:17 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 Sep 08 19:26:17 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:17 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:18 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (796e102d-57fe-4ed7-8b72-9a61740c8ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8087b1-4dcd-42bd-b574-a0bfa12a5a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8087b1-4dcd-42bd-b574-a0bfa12a5a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657252315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430797cc-c93a-4345-82db-8a00963f52a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:18Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf93319-0e4e-4178-b15a-f45d9f374471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf93319-0e4e-4178-b15a-f45d9f374471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140cef99-742d-45a8-942b-269f8c721749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (140cef99-742d-45a8-942b-269f8c721749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430797cc-c93a-4345-82db-8a00963f52a1', 'volume_name': 'volume-430797cc-c93a-4345-82db-8a00963f52a1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d20a0e-64f1-4958-b712-200c7c5a6986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d20a0e-64f1-4958-b712-200c7c5a6986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d8ce4-bbc2-4a68-9b8b-d6712f4c1e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume 430797cc-c93a-4345-82db-8a00963f52a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430797cc-c93a-4345-82db-8a00963f52a1', 'volume_size': 1} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7" returned: 0 in 0.449s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.200s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1690798693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47dc0297-eead-4816-8cb5-17db65f65652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:17Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume 47dc0297-eead-4816-8cb5-17db65f65652 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:18 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269d5b6e-b44f-4b33-9a1b-6504eea321ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848e76a4-6644-4b6b-9665-0795e93435d7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack sudo[100738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 1073741824 Sep 08 19:26:18 devstack sudo[100738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f0ef31-5b2e-4a37-a40c-42cb52913033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-848e76a4-6644-4b6b-9665-0795e93435d7 (848e76a4-6644-4b6b-9665-0795e93435d7): created successfully Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14f0ef31-5b2e-4a37-a40c-42cb52913033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (7a71b237-9770-440e-b283-82345c05b67f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6f60c61d-6f05-4244-a4d9-67ef0960d1dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (4309eb36-1adc-4bc6-a87e-0bf0dcf709a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b6b2b9-797c-47a9-b721-25e706a9d27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b6b2b9-797c-47a9-b721-25e706a9d27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701817836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30d5e09-4439-41a8-b849-8e5aea14820b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:19Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54f42b-929a-4937-ab1f-f0f5b56c2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc54f42b-929a-4937-ab1f-f0f5b56c2803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c2b38-a6c2-4cac-ae99-013ba9db3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c2b38-a6c2-4cac-ae99-013ba9db3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd30d5e09-4439-41a8-b849-8e5aea14820b', 'volume_name': 'volume-d30d5e09-4439-41a8-b849-8e5aea14820b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6410eb91-0ca6-4855-af87-69f12f4792f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6410eb91-0ca6-4855-af87-69f12f4792f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f56cd-3342-418a-9747-ceb87a13dea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:18 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume d30d5e09-4439-41a8-b849-8e5aea14820b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d30d5e09-4439-41a8-b849-8e5aea14820b', 'volume_size': 1} Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:18 devstack sudo[100738]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 1073741824" returned: 0 in 0.830s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (6a20ba13-332c-4d9e-b81e-a74818646119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dbb5dc-b37d-47d3-8f12-fc37384698b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dbb5dc-b37d-47d3-8f12-fc37384698b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883954053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca07a42-f7bb-4eb4-8baa-2589e6406ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:19Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466b1a9a-a2fd-4910-a660-69dc8f6fe641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466b1a9a-a2fd-4910-a660-69dc8f6fe641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7857f69b-6dce-44b6-9804-e20a4519ba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7857f69b-6dce-44b6-9804-e20a4519ba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca07a42-f7bb-4eb4-8baa-2589e6406ab5', 'volume_name': 'volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0dfa0-d261-4903-96c7-2f5edd979f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0dfa0-d261-4903-96c7-2f5edd979f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ebad6c-ea67-4bd6-b830-7189932f46e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume 8ca07a42-f7bb-4eb4-8baa-2589e6406ab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5', 'volume_size': 1} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:19 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 Sep 08 19:26:19 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:19 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652" returned: 0 in 0.287s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.286s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657252315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430797cc-c93a-4345-82db-8a00963f52a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:18Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume 430797cc-c93a-4345-82db-8a00963f52a1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:19 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1fa8d5-672e-4923-9c26-d277c7d026d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47dc0297-eead-4816-8cb5-17db65f65652', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 1073741824 Sep 08 19:26:19 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9312b2bb-9360-489d-a9fa-058d7bbc1118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:19 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-47dc0297-eead-4816-8cb5-17db65f65652 (47dc0297-eead-4816-8cb5-17db65f65652): created successfully Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9312b2bb-9360-489d-a9fa-058d7bbc1118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (a8509121-8e54-4954-9db9-b436d5642799) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-72a6db75-e6e0-4d79-9198-6f707e696af7 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:19 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 1073741824" returned: 0 in 0.555s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:20 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 Sep 08 19:26:20 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:20 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.475s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-701817836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d30d5e09-4439-41a8-b849-8e5aea14820b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:19Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume d30d5e09-4439-41a8-b849-8e5aea14820b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:20 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8d8ce4-bbc2-4a68-9b8b-d6712f4c1e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430797cc-c93a-4345-82db-8a00963f52a1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b115903d-8455-47ff-89e7-c0ae899e9df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:20 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b 1073741824 Sep 08 19:26:20 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:20 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-430797cc-c93a-4345-82db-8a00963f52a1 (430797cc-c93a-4345-82db-8a00963f52a1): created successfully Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b115903d-8455-47ff-89e7-c0ae899e9df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (796e102d-57fe-4ed7-8b72-9a61740c8ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3fc93d78-20a4-42cf-a98e-dd095f2718dc tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:20 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b 1073741824" returned: 0 in 0.496s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:20 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b Sep 08 19:26:20 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:21 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.153s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-883954053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca07a42-f7bb-4eb4-8baa-2589e6406ab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ef75fbea3be47408f942240bb8c672b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:19Z,use_quota=True,user_id='57dc3aafa8e147ca94778fec6bee4a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Creating volume 8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:21 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436f56cd-3342-418a-9747-ceb87a13dea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d30d5e09-4439-41a8-b849-8e5aea14820b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:21 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 1073741824 Sep 08 19:26:21 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5fba32-7c3b-4523-a184-69f100363ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:21 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-d30d5e09-4439-41a8-b849-8e5aea14820b (d30d5e09-4439-41a8-b849-8e5aea14820b): created successfully Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5fba32-7c3b-4523-a184-69f100363ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (4309eb36-1adc-4bc6-a87e-0bf0dcf709a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-58661a0a-02de-4cde-aeef-e361e1d7bb9d tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:21 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 1073741824" returned: 0 in 0.564s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:21 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 Sep 08 19:26:21 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:22 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" returned: 0 in 0.405s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35ebad6c-ea67-4bd6-b830-7189932f46e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5277b11c-a6d5-4ad9-b7ba-862671917bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:22 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Volume volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 (8ca07a42-f7bb-4eb4-8baa-2589e6406ab5): created successfully Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5277b11c-a6d5-4ad9-b7ba-862671917bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Flow 'volume_create_manager' (6a20ba13-332c-4d9e-b81e-a74818646119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c2eb35ed-42a1-41d3-8d0e-e2829baf111b tempest-CreateVolumesFromSnapshotTest-208736648 None] Created volume successfully. Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f52d07-080e-4e07-8b4c-dfb3a832dcd7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:23 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 Sep 08 19:26:23 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:23 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" returned: 0 in 0.495s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:23 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5 Sep 08 19:26:23 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:23 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5" released by "delete_volume" :: held 0.834s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['3f5e51e9-f59b-43b2-aece-00edc3a3fbcd', '1e487194-0a8d-4750-8c89-24adbeacbcd3', '552a737b-8687-45d8-a653-f4c9d0ddf3fb', '76f9b8bd-884c-4569-95f0-3c8b1d8ea07c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:23 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:23 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-d30d5e09-4439-41a8-b849-8e5aea14820b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-d30d5e09-4439-41a8-b849-8e5aea14820b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-d30d5e09-4439-41a8-b849-8e5aea14820b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-d30d5e09-4439-41a8-b849-8e5aea14820b" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f65900-240e-411a-b0b0-fe11b205d4c8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:24 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-762792d0-7adf-45aa-bbef-1fb5db1d67dd tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-8ca07a42-f7bb-4eb4-8baa-2589e6406ab5-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:24 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b Sep 08 19:26:24 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:24 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b" returned: 0 in 0.554s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:24 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b Sep 08 19:26:24 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:25 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d30d5e09-4439-41a8-b849-8e5aea14820b" returned: 0 in 0.361s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-d30d5e09-4439-41a8-b849-8e5aea14820b" released by "delete_volume" :: held 1.009s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['074fe6cd-d394-4ef3-9441-d309e959ddd6', '7140d2a4-e8cd-4caf-844c-b57932637c70', '916a5ac9-e37c-4b28-9ef1-a5770ecbd28a', 'dd457a6c-cee3-49fd-969e-26df5f74dc6c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:25 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:25 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:25 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.307s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4e5e1e9b-77a4-4035-a7c2-8100b6c521fc tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-d30d5e09-4439-41a8-b849-8e5aea14820b-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-430797cc-c93a-4345-82db-8a00963f52a1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-430797cc-c93a-4345-82db-8a00963f52a1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-430797cc-c93a-4345-82db-8a00963f52a1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-430797cc-c93a-4345-82db-8a00963f52a1" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd28966-65c0-450d-9970-f8021d897a80]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:26 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 Sep 08 19:26:26 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:26 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1" returned: 0 in 0.389s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:26 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1 Sep 08 19:26:26 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:27 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-430797cc-c93a-4345-82db-8a00963f52a1" returned: 0 in 0.331s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-430797cc-c93a-4345-82db-8a00963f52a1" released by "delete_volume" :: held 0.767s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['5e491ca0-c8e5-42f6-879c-f0ba425bf4f7', '705708eb-17ab-4e8f-b6e8-d52b608d7218', 'd4249627-1c7d-4acd-a340-1cba1bbcc2ee', 'f87a4713-c859-433f-a048-b9bdd8cd5998'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:27 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:27 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-47dc0297-eead-4816-8cb5-17db65f65652-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-47dc0297-eead-4816-8cb5-17db65f65652-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-47dc0297-eead-4816-8cb5-17db65f65652" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:27 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.284s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-47dc0297-eead-4816-8cb5-17db65f65652" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65af27-851f-410c-aa0e-56d84b9eb775]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1ec59a38-086e-42b5-a1cf-961d7adb859c tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-430797cc-c93a-4345-82db-8a00963f52a1-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:27 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 Sep 08 19:26:27 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:28 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652" returned: 0 in 0.450s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:28 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652 Sep 08 19:26:28 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:28 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-47dc0297-eead-4816-8cb5-17db65f65652" returned: 0 in 0.304s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-47dc0297-eead-4816-8cb5-17db65f65652" released by "delete_volume" :: held 0.825s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['bc1375bc-d276-4549-9421-e705eba4c47c', 'c91be9b3-f0f3-48a4-a851-cfb720a4d091', '7eab91ab-7659-4bfb-bb26-cd0e4fcd0442', '542c97c1-a728-4034-bf13-e387e36fd87e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:28 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:28 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-848e76a4-6644-4b6b-9665-0795e93435d7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-848e76a4-6644-4b6b-9665-0795e93435d7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-848e76a4-6644-4b6b-9665-0795e93435d7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-848e76a4-6644-4b6b-9665-0795e93435d7" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[db164d2d-1567-434f-a333-7101c68a8a7b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:29 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.410s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a850a930-d4b9-4f04-b6bf-8e46eea9ef46 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-47dc0297-eead-4816-8cb5-17db65f65652-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:29 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 Sep 08 19:26:29 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:29 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7" returned: 0 in 0.486s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:29 devstack sudo[100826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7 Sep 08 19:26:29 devstack sudo[100826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:29 devstack sudo[100826]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-848e76a4-6644-4b6b-9665-0795e93435d7" returned: 0 in 0.304s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-848e76a4-6644-4b6b-9665-0795e93435d7" released by "delete_volume" :: held 0.854s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:29 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['6e126daa-cefc-4eb0-a5a9-f1f5abfce6f4', '6396db68-8449-4351-b00e-06905b606238', 'bdd11f46-a73b-4a35-bf64-f1fce9f2d850', '0bbeb0d1-7a55-4617-ac80-8ed9aad2e998'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-7b1fccb1-9b4b-420b-86ea-fc328e172f09-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:30 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:30 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-7b1fccb1-9b4b-420b-86ea-fc328e172f09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.132s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-7b1fccb1-9b4b-420b-86ea-fc328e172f09" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-7b1fccb1-9b4b-420b-86ea-fc328e172f09" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleting offline snapshot 7b1fccb1-9b4b-420b-86ea-fc328e172f09 of volume 00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] snapshot_file for this snap is: volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e584c97a-accf-401e-9598-07acdfb36dbc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:30 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.420s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e419e96a-becd-48ef-b28a-aefb48e41132 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-848e76a4-6644-4b6b-9665-0795e93435d7-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:30 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 Sep 08 19:26:30 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:30 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09" returned: 0 in 0.461s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f423aa-311b-471d-83f7-a79f21d120f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c059bb6d-45c1-4c79-b3b9-869dd2fcbddf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:31 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 Sep 08 19:26:31 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:31 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6" returned: 0 in 0.458s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:31 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 Sep 08 19:26:31 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:31 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09" returned: 0 in 0.475s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:31 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09 Sep 08 19:26:31 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:32 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6.7b1fccb1-9b4b-420b-86ea-fc328e172f09" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-7b1fccb1-9b4b-420b-86ea-fc328e172f09" released by "_delete_snapshot" :: held 1.862s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" released by "delete_snapshot" :: held 1.913s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:32 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['56e0e60a-5509-42ce-af54-9ba5dd3209df', 'f305d801-fb0b-4732-af07-c56ca68cb197', '7a57a0c8-f146-4f18-9e82-421c8dd242fd', '0fa4c227-52ac-43ba-ae21-b9f3c2a8fd62'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:32 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Delete snapshot completed successfully. Sep 08 19:26:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-de738172-69c1-4b7a-895d-c13aceff7997 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-7b1fccb1-9b4b-420b-86ea-fc328e172f09-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-00f423aa-311b-471d-83f7-a79f21d120f6-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-00f423aa-311b-471d-83f7-a79f21d120f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b8fc1d-4a7e-4240-9ba3-313f2be53399]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:33 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 Sep 08 19:26:33 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:34 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6" returned: 0 in 0.490s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:34 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6 Sep 08 19:26:34 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:34 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-00f423aa-311b-471d-83f7-a79f21d120f6" returned: 0 in 0.355s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-quobyte-00f423aa-311b-471d-83f7-a79f21d120f6" released by "delete_volume" :: held 0.929s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Created reservations ['603da961-bb51-48b4-8e5f-1c98c75a35cc', '234c90f0-f8ab-4f1c-a3ab-ac900c7fa0c5', '47a719f0-e3c1-4acb-90a3-2b3518d37a85', '80430078-0f94-4491-b3ec-2496a73c855b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:34 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:34 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:34 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.320s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Deleted volume successfully. Sep 08 19:26:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-60573797-46f7-4578-b68b-830ab3761484 tempest-CreateVolumesFromSnapshotTest-208736648 None] Lock "cinder-00f423aa-311b-471d-83f7-a79f21d120f6-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Flow 'volume_create_manager' (e76c7cfd-bb40-43c5-bf45-1ab57a2acfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7306ae0d-bdb8-4fa5-845d-b24916f2e907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7306ae0d-bdb8-4fa5-845d-b24916f2e907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2126407041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f537d256-43d1-48ee-a220-5824925b6e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728550d1e71d47bba24ee8d0af3810c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:43Z,use_quota=True,user_id='3250dda5b01f4b8e9cee9c5efc5c93a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a0309-54d4-467e-a0c7-aced89160254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731a0309-54d4-467e-a0c7-aced89160254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3172e116-cdb0-47da-9faa-38dc3393fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3172e116-cdb0-47da-9faa-38dc3393fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f537d256-43d1-48ee-a220-5824925b6e5b', 'volume_name': 'volume-f537d256-43d1-48ee-a220-5824925b6e5b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da57648-6257-4c41-8afb-20f3b578b081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da57648-6257-4c41-8afb-20f3b578b081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6d7076-90de-4d8a-9b1e-748dd31722fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Volume f537d256-43d1-48ee-a220-5824925b6e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f537d256-43d1-48ee-a220-5824925b6e5b', 'volume_size': 1} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2126407041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f537d256-43d1-48ee-a220-5824925b6e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='728550d1e71d47bba24ee8d0af3810c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:43Z,use_quota=True,user_id='3250dda5b01f4b8e9cee9c5efc5c93a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Creating volume f537d256-43d1-48ee-a220-5824925b6e5b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:43 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:43 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b 1073741824 Sep 08 19:26:43 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:44 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b 1073741824" returned: 0 in 0.596s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:44 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b Sep 08 19:26:44 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:44 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6d7076-90de-4d8a-9b1e-748dd31722fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f537d256-43d1-48ee-a220-5824925b6e5b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78048a40-50f8-491b-8318-97b76cd131e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:44 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Volume volume-f537d256-43d1-48ee-a220-5824925b6e5b (f537d256-43d1-48ee-a220-5824925b6e5b): created successfully Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78048a40-50f8-491b-8318-97b76cd131e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:44 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Flow 'volume_create_manager' (e76c7cfd-bb40-43c5-bf45-1ab57a2acfbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1876c7ea-8ce0-4237-959a-398db28f39d4 tempest-VolumeQuotasNegativeTestJSON-183921586 None] Created volume successfully. Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Flow 'volume_create_manager' (bf556294-c5f7-4cc6-92e3-75359e2432c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cbeb5f-5fbd-4abb-97e4-3bc9819d9c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cbeb5f-5fbd-4abb-97e4-3bc9819d9c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8c2c12-116e-471d-b42c-228a3f04722e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf3112ce78a4241a705e427e5a22182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:45Z,use_quota=True,user_id='2583b310ef9749a09259ab9b6aac6d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cef15c0-8b42-4375-8915-396e97e147f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cef15c0-8b42-4375-8915-396e97e147f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4cc07b-2f34-4195-aedc-ce3b985d3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:45 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b4cc07b-2f34-4195-aedc-ce3b985d3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb8c2c12-116e-471d-b42c-228a3f04722e', 'volume_name': 'volume-fb8c2c12-116e-471d-b42c-228a3f04722e', 'volume_size': 1, 'image_id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91ab687ab89752aa183f5d5ba98c0092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bf3112ce78a4241a705e427e5a22182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6f42da97b57b6d8da29cc7c57b5bdd37f299380bd3fe40bb7acf9ef485a823ba9d1de859dbba3e6d4ccce100f5f0b94662508dd22d1f2bc4f63530332db4787', 'id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'created_at': datetime.datetime(2026, 9, 8, 17, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/193e152c-f530-4252-aa3b-c2c64cbe2a98/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221dc452-eb70-4ef8-a170-cb43f588c137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221dc452-eb70-4ef8-a170-cb43f588c137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf849bf-e30a-41aa-9acb-da6f77ea8b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Volume fb8c2c12-116e-471d-b42c-228a3f04722e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb8c2c12-116e-471d-b42c-228a3f04722e', 'volume_size': 1, 'image_id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91ab687ab89752aa183f5d5ba98c0092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bf3112ce78a4241a705e427e5a22182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6f42da97b57b6d8da29cc7c57b5bdd37f299380bd3fe40bb7acf9ef485a823ba9d1de859dbba3e6d4ccce100f5f0b94662508dd22d1f2bc4f63530332db4787', 'id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'created_at': datetime.datetime(2026, 9, 8, 17, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/193e152c-f530-4252-aa3b-c2c64cbe2a98/file', 'properties': {}}, 'image_service': } Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Trying to clone fb8c2c12-116e-471d-b42c-228a3f04722e from image 193e152c-f530-4252-aa3b-c2c64cbe2a98 at location (None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:26:46 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f584328-83e2-4216-a955-2e263ac454a4]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:46 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:46 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:46 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:47 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:47 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Acquiring lock "cinder-f537d256-43d1-48ee-a220-5824925b6e5b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "cinder-f537d256-43d1-48ee-a220-5824925b6e5b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Acquiring lock "cinder-quobyte-f537d256-43d1-48ee-a220-5824925b6e5b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "cinder-quobyte-f537d256-43d1-48ee-a220-5824925b6e5b" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a535d62a-bc46-4ee6-b08b-b0ee3411b781]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:47 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 1 in 0.508s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Temporary image 193e152c-f530-4252-aa3b-c2c64cbe2a98 is fetched for user 2583b310ef9749a09259ab9b6aac6d51. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:26:47 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b Sep 08 19:26:47 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[34038c95-571f-4454-9374-2ade5473c322]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:47 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:47 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:47 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b" returned: 0 in 0.560s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:47 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b Sep 08 19:26:47 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:47 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:48 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:48 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:48 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f537d256-43d1-48ee-a220-5824925b6e5b" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "cinder-quobyte-f537d256-43d1-48ee-a220-5824925b6e5b" released by "delete_volume" :: held 0.970s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Flow 'volume_create_manager' (087df28c-5014-4051-83ef-3f87692bc78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bab883-0ada-46fe-99d7-1c166925a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bab883-0ada-46fe-99d7-1c166925a64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1418941112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693aef9-e4bd-4216-a9ba-1cc967765c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a005aa1ce0b4d67ade26f1cdc407ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:48Z,use_quota=True,user_id='c8c44c5203994d9a84ea7ea13721c929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8db8f4a-b1e5-4dbd-a3e9-f90114a380c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8db8f4a-b1e5-4dbd-a3e9-f90114a380c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d13ae03-5dd8-4414-bdb1-376fe62afd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d13ae03-5dd8-4414-bdb1-376fe62afd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c693aef9-e4bd-4216-a9ba-1cc967765c44', 'volume_name': 'volume-c693aef9-e4bd-4216-a9ba-1cc967765c44', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f523cb-0805-4a92-a720-7bbc2e07e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6f523cb-0805-4a92-a720-7bbc2e07e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704ec971-76b5-4592-bcae-a73ada3ec340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:48 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Volume c693aef9-e4bd-4216-a9ba-1cc967765c44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c693aef9-e4bd-4216-a9ba-1cc967765c44', 'volume_size': 1} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1418941112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c693aef9-e4bd-4216-a9ba-1cc967765c44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a005aa1ce0b4d67ade26f1cdc407ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:48Z,use_quota=True,user_id='c8c44c5203994d9a84ea7ea13721c929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Creating volume c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:48 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:48 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 1073741824 Sep 08 19:26:48 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Created reservations ['755e75a4-2373-47db-b9b0-d21f8d2875bc', '9dd2ff5c-c54a-409b-96e5-7cdef201a967', 'c8cc355f-d299-4391-afbc-47303f4195bd', '2373f811-8c35-4d3f-b93f-74bb7ed6eb56'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:48 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 1 in 0.496s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:48 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:48 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:48 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.302s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Deleted volume successfully. Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aeebfb6d-7899-4124-8b55-0a2e88a04f8b tempest-VolumeQuotasNegativeTestJSON-183921586 None] Lock "cinder-f537d256-43d1-48ee-a220-5824925b6e5b-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:48 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 1073741824" returned: 0 in 0.549s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:48 devstack sudo[100944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:26:48 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:49 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.303s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8c2c12-116e-471d-b42c-228a3f04722e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf3112ce78a4241a705e427e5a22182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:45Z,use_quota=True,user_id='2583b310ef9749a09259ab9b6aac6d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Creating volume fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:49 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:49 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1073741824 Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704ec971-76b5-4592-bcae-a73ada3ec340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c693aef9-e4bd-4216-a9ba-1cc967765c44', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:49 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf03adf-d6a2-4ff3-9835-47f516f81c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Volume volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 (c693aef9-e4bd-4216-a9ba-1cc967765c44): created successfully Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf03adf-d6a2-4ff3-9835-47f516f81c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Flow 'volume_create_manager' (087df28c-5014-4051-83ef-3f87692bc78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e1a90fb5-6626-41a7-8a42-b73c883c5512 tempest-SnapshotDependencyTests-976541803 None] Created volume successfully. Sep 08 19:26:49 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1073741824" returned: 0 in 0.667s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:49 devstack sudo[100953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e Sep 08 19:26:49 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:50 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Attempting download of 193e152c-f530-4252-aa3b-c2c64cbe2a98 ((None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}])) to volume fb8c2c12-116e-471d-b42c-228a3f04722e. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced73d81-2f8d-41e3-b119-bdd6ef53756e]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:50 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl Sep 08 19:26:50 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Creating offline snapshot 04cb52e7-f4cd-4658-a4d4-da6ec67012bd of volume c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe48730-25eb-4b14-9b71-0312f0f96b56]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:50 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl" returned: 0 in 0.477s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:51 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:26:51 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:51 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl Sep 08 19:26:51 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:51 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.597s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:51 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd 1G Sep 08 19:26:51 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:51 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl" returned: 1 in 0.536s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_193e152c-f530-4252-aa3b-c2c64cbe2a98_smj6dprl' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96ed5f4-9fac-46ca-aaea-86741dcdc360]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:51 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:51 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:52 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:52 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd 1G" returned: 0 in 0.636s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:52 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:26:52 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:52 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD Sep 08 19:26:52 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:52 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] 193e152c-f530-4252-aa3b-c2c64cbe2a98 was raw, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:52 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:52 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd is being set with open permissions: ugo+rw Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:52 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e Sep 08 19:26:52 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:52 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:26:52 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:52 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:52 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info Sep 08 19:26:52 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:53 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e" returned: 0 in 0.634s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_193e152c-f530-4252-aa3b-c2c64cbe2a98_wg5hp4cjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:26:53 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:53 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1G Sep 08 19:26:53 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:53 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:53 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info is being set with open permissions: ugo+rw Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:53 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info Sep 08 19:26:53 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:53 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e 1G" returned: 0 in 0.444s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Downloaded image 193e152c-f530-4252-aa3b-c2c64cbe2a98 ((None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}])) to volume fb8c2c12-116e-471d-b42c-228a3f04722e successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Temporary image 193e152c-f530-4252-aa3b-c2c64cbe2a98 for user 2583b310ef9749a09259ab9b6aac6d51 is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Marking volume fb8c2c12-116e-471d-b42c-228a3f04722e as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Copying metadata from image 193e152c-f530-4252-aa3b-c2c64cbe2a98 to fb8c2c12-116e-471d-b42c-228a3f04722e. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Creating volume glance metadata for volume fb8c2c12-116e-471d-b42c-228a3f04722e backed by image 193e152c-f530-4252-aa3b-c2c64cbe2a98 with: {'image_id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '91ab687ab89752aa183f5d5ba98c0092', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf849bf-e30a-41aa-9acb-da6f77ea8b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8c2c12-116e-471d-b42c-228a3f04722e', 'volume_size': 1, 'image_id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/193e152c-f530-4252-aa3b-c2c64cbe2a98', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91ab687ab89752aa183f5d5ba98c0092', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8bf3112ce78a4241a705e427e5a22182', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a6f42da97b57b6d8da29cc7c57b5bdd37f299380bd3fe40bb7acf9ef485a823ba9d1de859dbba3e6d4ccce100f5f0b94662508dd22d1f2bc4f63530332db4787', 'id': '193e152c-f530-4252-aa3b-c2c64cbe2a98', 'created_at': datetime.datetime(2026, 9, 8, 17, 26, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 26, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/193e152c-f530-4252-aa3b-c2c64cbe2a98/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf0b858-0dac-4fde-a25b-d163748da3ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Volume volume-fb8c2c12-116e-471d-b42c-228a3f04722e (fb8c2c12-116e-471d-b42c-228a3f04722e): created successfully Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf0b858-0dac-4fde-a25b-d163748da3ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Flow 'volume_create_manager' (bf556294-c5f7-4cc6-92e3-75359e2432c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:53 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.info" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1e89e83e-0173-4880-9ae6-e79536547a7d tempest-VolumeImageDependencyTests-275087721 None] Created volume successfully. Sep 08 19:26:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-727012bf-8a31-4179-8719-3cac094ba803 tempest-SnapshotDependencyTests-976541803 None] Create snapshot completed successfully Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Acquiring lock "cinder-fb8c2c12-116e-471d-b42c-228a3f04722e-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "cinder-fb8c2c12-116e-471d-b42c-228a3f04722e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Acquiring lock "cinder-quobyte-fb8c2c12-116e-471d-b42c-228a3f04722e" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "cinder-quobyte-fb8c2c12-116e-471d-b42c-228a3f04722e" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[201d2b3f-5f75-4795-8fcf-4280e45345c4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:54 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e Sep 08 19:26:54 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:54 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e" returned: 0 in 0.499s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:54 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e Sep 08 19:26:54 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Flow 'volume_create_manager' (99fda534-e687-4fb5-8008-1389e025e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d2c8b1-5af4-42c2-b166-a718f1bb894d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d2c8b1-5af4-42c2-b166-a718f1bb894d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa037ee-8759-4688-9e8c-04e539c0db2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a005aa1ce0b4d67ade26f1cdc407ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04cb52e7-f4cd-4658-a4d4-da6ec67012bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:55Z,use_quota=True,user_id='c8c44c5203994d9a84ea7ea13721c929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7764a5b1-8d90-47d3-b4fe-a1128bd3ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7764a5b1-8d90-47d3-b4fe-a1128bd3ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c98232-c98e-4b73-bcc9-bbcc18a098e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15c98232-c98e-4b73-bcc9-bbcc18a098e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'daa037ee-8759-4688-9e8c-04e539c0db2b', 'volume_name': 'volume-daa037ee-8759-4688-9e8c-04e539c0db2b', 'volume_size': 1, 'snapshot_id': '04cb52e7-f4cd-4658-a4d4-da6ec67012bd'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042cbe47-df61-48e2-b645-a906bf867eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (042cbe47-df61-48e2-b645-a906bf867eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc698d46-2fc7-491c-8664-580236ebdee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Volume daa037ee-8759-4688-9e8c-04e539c0db2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-daa037ee-8759-4688-9e8c-04e539c0db2b', 'volume_size': 1, 'snapshot_id': '04cb52e7-f4cd-4658-a4d4-da6ec67012bd'} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-daa037ee-8759-4688-9e8c-04e539c0db2b" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-daa037ee-8759-4688-9e8c-04e539c0db2b" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Creating volume daa037ee-8759-4688-9e8c-04e539c0db2b from snapshot 04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] snapshot: 04cb52e7-f4cd-4658-a4d4-da6ec67012bd, volume: daa037ee-8759-4688-9e8c-04e539c0db2b, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d76bf-8ede-4185-81cd-9da8cdbfc218]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:55 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fb8c2c12-116e-471d-b42c-228a3f04722e" returned: 0 in 0.404s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "cinder-quobyte-fb8c2c12-116e-471d-b42c-228a3f04722e" released by "delete_volume" :: held 0.981s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:55 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:26:55 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Created reservations ['6c132347-90ed-4d54-b1f8-db166d256078', 'ac88d994-59f7-4085-84a8-9c5ee7ccb34d', '16fea636-b556-4e52-9a8a-918dd72694e9', 'ae2a736a-ab37-498f-bc1d-38d00768819c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:55 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:26:55 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Flow 'volume_create_manager' (b1b4591c-23d7-432b-83a7-d0401664f010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef4d2eb-3870-4c32-b53e-3671f118df5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ef4d2eb-3870-4c32-b53e-3671f118df5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-235250174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e6df79-6658-4648-899a-f4f062180345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683940d2c0724b489ede8accfc601446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:56Z,use_quota=True,user_id='34bdaeb31b1048699fbb28ed6afb4165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9a6bca-bfdf-4d8f-ad5a-4a3ad2f7340a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9a6bca-bfdf-4d8f-ad5a-4a3ad2f7340a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea742be1-92eb-4722-9f31-8df3d859b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea742be1-92eb-4722-9f31-8df3d859b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53e6df79-6658-4648-899a-f4f062180345', 'volume_name': 'volume-53e6df79-6658-4648-899a-f4f062180345', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f86d8-4e3f-4010-b0a9-c354ffd3173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f86d8-4e3f-4010-b0a9-c354ffd3173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508b9017-d2af-4e6b-88af-305d926f4fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume 53e6df79-6658-4648-899a-f4f062180345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53e6df79-6658-4648-899a-f4f062180345', 'volume_size': 1} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:55 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.529s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c693aef9-e4bd-4216-a9ba-1cc967765c44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b441c4dc-ea46-4be2-8752-36917518a78c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:55 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:26:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Deleted volume successfully. Sep 08 19:26:55 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:26:55 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:26:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9211560e-c869-4576-aa4c-983b8bee58f4 tempest-VolumeImageDependencyTests-275087721 None] Lock "cinder-fb8c2c12-116e-471d-b42c-228a3f04722e-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Flow 'volume_create_manager' (d9f53b4f-5a51-4b60-9265-184ffd55b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec751cb9-b476-4bea-807a-0b726599107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec751cb9-b476-4bea-807a-0b726599107d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1588696385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998c7dd4-3099-49b3-bd11-3342e3794f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683940d2c0724b489ede8accfc601446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:56Z,use_quota=True,user_id='34bdaeb31b1048699fbb28ed6afb4165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292089da-28e2-4ea0-bd8f-0c6ec49d5242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292089da-28e2-4ea0-bd8f-0c6ec49d5242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4e9f31-332f-4c08-ac72-4779cc378919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:56 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4e9f31-332f-4c08-ac72-4779cc378919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '998c7dd4-3099-49b3-bd11-3342e3794f37', 'volume_name': 'volume-998c7dd4-3099-49b3-bd11-3342e3794f37', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6e4e7e-d8b2-4391-8020-45f795b93462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d6e4e7e-d8b2-4391-8020-45f795b93462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae9b5c9-2bdc-4c4d-b121-aba081a7a020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:26:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume 998c7dd4-3099-49b3-bd11-3342e3794f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-998c7dd4-3099-49b3-bd11-3342e3794f37', 'volume_size': 1} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.514s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:26:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:26:56 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b Sep 08 19:26:56 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:02 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b" returned: 0 in 6.135s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:27:02 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Converted 1024.00 MB image at 166.80 MB/s Sep 08 19:27:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b is being set with open permissions: ugo+rw Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:02 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b Sep 08 19:27:02 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Flow 'volume_create_manager' (76eeccd1-19ac-4678-964f-7b31b8cce53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51110d62-23bb-4f77-bc7b-3c4dab8057a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51110d62-23bb-4f77-bc7b-3c4dab8057a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313317817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f44cd2f-9415-498b-96ab-61be62d545d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487aaf282ec5470f84c2feb6077739db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:02Z,use_quota=True,user_id='ca11e5b2d7534596bf9c5d17e3908a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d10f1-9c8d-4834-9fb6-70352b5006b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4d10f1-9c8d-4834-9fb6-70352b5006b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a4b9a-2d1f-47ad-a691-a613497aa71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a4b9a-2d1f-47ad-a691-a613497aa71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f44cd2f-9415-498b-96ab-61be62d545d6', 'volume_name': 'volume-7f44cd2f-9415-498b-96ab-61be62d545d6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a25dd99-32ae-4a72-b735-2f2044e46f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a25dd99-32ae-4a72-b735-2f2044e46f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a986c641-6ef6-4809-b83e-613924cd5646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Volume 7f44cd2f-9415-498b-96ab-61be62d545d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f44cd2f-9415-498b-96ab-61be62d545d6', 'volume_size': 1} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:02 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b" returned: 0 in 0.273s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" released by "_copy_volume_from_snapshot" :: held 7.558s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-daa037ee-8759-4688-9e8c-04e539c0db2b" released by "_create_volume_from_snapshot" :: held 7.633s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.654s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.057s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-235250174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53e6df79-6658-4648-899a-f4f062180345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683940d2c0724b489ede8accfc601446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:56Z,use_quota=True,user_id='34bdaeb31b1048699fbb28ed6afb4165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Creating volume 53e6df79-6658-4648-899a-f4f062180345 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:02 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:02 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 1073741824 Sep 08 19:27:02 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc698d46-2fc7-491c-8664-580236ebdee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa037ee-8759-4688-9e8c-04e539c0db2b', 'volume_size': 1, 'snapshot_id': '04cb52e7-f4cd-4658-a4d4-da6ec67012bd'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d8870-d242-4c36-b592-3ccd97b140b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Volume volume-daa037ee-8759-4688-9e8c-04e539c0db2b (daa037ee-8759-4688-9e8c-04e539c0db2b): created successfully Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d8870-d242-4c36-b592-3ccd97b140b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Flow 'volume_create_manager' (99fda534-e687-4fb5-8008-1389e025e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8e2ecbe8-1d47-4638-b237-b8010fc8d80f tempest-SnapshotDependencyTests-976541803 None] Created volume successfully. Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Deleting offline snapshot 04cb52e7-f4cd-4658-a4d4-da6ec67012bd of volume c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] snapshot_file for this snap is: volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a603657-ccaf-4159-84c0-8262101ce1db]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:03 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:27:03 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:03 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 1073741824" returned: 0 in 0.692s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:03 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 Sep 08 19:27:03 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:03 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.452s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c693aef9-e4bd-4216-a9ba-1cc967765c44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[45820bc1-fde3-4da5-9422-84689fc9cb5b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:03 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345" returned: 0 in 0.321s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.583s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:26:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1588696385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=998c7dd4-3099-49b3-bd11-3342e3794f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='683940d2c0724b489ede8accfc601446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:26:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:26:56Z,use_quota=True,user_id='34bdaeb31b1048699fbb28ed6afb4165',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Creating volume 998c7dd4-3099-49b3-bd11-3342e3794f37 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:03 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508b9017-d2af-4e6b-88af-305d926f4fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53e6df79-6658-4648-899a-f4f062180345', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:03 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 1073741824 Sep 08 19:27:03 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e0eea-fd4f-46e3-92dc-7f90ab1404f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume volume-53e6df79-6658-4648-899a-f4f062180345 (53e6df79-6658-4648-899a-f4f062180345): created successfully Sep 08 19:27:03 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:27:03 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9e0eea-fd4f-46e3-92dc-7f90ab1404f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Flow 'volume_create_manager' (b1b4591c-23d7-432b-83a7-d0401664f010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-00f22d3d-000a-4c23-8507-3739001af14b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Created volume successfully. Sep 08 19:27:04 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 1073741824" returned: 0 in 0.641s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:04 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.747s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:04 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:27:04 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:04 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 Sep 08 19:27:04 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:04 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37" returned: 0 in 0.342s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.403s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1313317817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f44cd2f-9415-498b-96ab-61be62d545d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487aaf282ec5470f84c2feb6077739db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:02Z,use_quota=True,user_id='ca11e5b2d7534596bf9c5d17e3908a3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Creating volume 7f44cd2f-9415-498b-96ab-61be62d545d6 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:05 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:05 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 1073741824 Sep 08 19:27:05 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae9b5c9-2bdc-4c4d-b121-aba081a7a020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-998c7dd4-3099-49b3-bd11-3342e3794f37', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd523481-fb25-4e58-9574-a519781012f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:05 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Volume volume-998c7dd4-3099-49b3-bd11-3342e3794f37 (998c7dd4-3099-49b3-bd11-3342e3794f37): created successfully Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd523481-fb25-4e58-9574-a519781012f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Flow 'volume_create_manager' (d9f53b4f-5a51-4b60-9265-184ffd55b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:05 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97d3f1de-55f9-4632-aa6c-8dbaab5b407c tempest-TestServerVolumeAttachmentScenario-1696631547 None] Created volume successfully. Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.508s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:05 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd Sep 08 19:27:05 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:05 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44.04cb52e7-f4cd-4658-a4d4-da6ec67012bd" returned: 0 in 0.331s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-04cb52e7-f4cd-4658-a4d4-da6ec67012bd" released by "_delete_snapshot" :: held 2.198s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" released by "delete_snapshot" :: held 2.242s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Created reservations ['c7a7d7e5-81d3-40af-844e-d8a1c1d938a4', 'e07b02d1-8063-4ff1-b421-646722fe79df', '217ab667-d71f-404c-a24d-33887f0e14d8', 'ea532c39-fb55-4abc-a4f8-33144792c7b2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:05 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 1073741824" returned: 0 in 0.718s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Delete snapshot completed successfully. Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd2c9c66-9275-46b6-93e1-c5d5e6521487 tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-04cb52e7-f4cd-4658-a4d4-da6ec67012bd-delete_snapshot" released by "delete_snapshot" :: held 2.507s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:05 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 Sep 08 19:27:05 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:06 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6" returned: 0 in 0.355s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a986c641-6ef6-4809-b83e-613924cd5646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f44cd2f-9415-498b-96ab-61be62d545d6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba8e1fe-c831-4eec-b23a-99253c7f19f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Volume volume-7f44cd2f-9415-498b-96ab-61be62d545d6 (7f44cd2f-9415-498b-96ab-61be62d545d6): created successfully Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba8e1fe-c831-4eec-b23a-99253c7f19f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Flow 'volume_create_manager' (76eeccd1-19ac-4678-964f-7b31b8cce53c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7d52b010-4e58-43a4-b6a4-5033042aa2a2 tempest-VolumesServicesTestJSON-1131721952 None] Created volume successfully. Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-c693aef9-e4bd-4216-a9ba-1cc967765c44-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-c693aef9-e4bd-4216-a9ba-1cc967765c44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[be811509-66dd-4e39-8aa7-281290846360]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:06 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:27:06 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Acquiring lock "cinder-7f44cd2f-9415-498b-96ab-61be62d545d6-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "cinder-7f44cd2f-9415-498b-96ab-61be62d545d6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Acquiring lock "cinder-quobyte-7f44cd2f-9415-498b-96ab-61be62d545d6" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "cinder-quobyte-7f44cd2f-9415-498b-96ab-61be62d545d6" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba3172-97a0-4aba-85d2-544628505afa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:07 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 Sep 08 19:27:07 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:07 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.546s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:07 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44 Sep 08 19:27:07 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:07 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c693aef9-e4bd-4216-a9ba-1cc967765c44" returned: 0 in 0.307s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:07 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6" returned: 0 in 0.530s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-c693aef9-e4bd-4216-a9ba-1cc967765c44" released by "delete_volume" :: held 0.980s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:07 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6 Sep 08 19:27:07 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Created reservations ['b409895c-74dd-4eb1-b44c-c540c43cd030', '2d2b1c01-6db1-4b2b-b692-58ea932a694b', '2a5b2c61-c073-4a06-9307-4794415a7b0d', 'ed63a112-1982-402e-985e-2cbdb1a6f445'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:07 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:07 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-daa037ee-8759-4688-9e8c-04e539c0db2b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-daa037ee-8759-4688-9e8c-04e539c0db2b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" acquired by "delete_volume" :: waited 0.055s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadebf70-17cc-4755-9801-981e7f52765f]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:08 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-7f44cd2f-9415-498b-96ab-61be62d545d6" returned: 0 in 0.601s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:08 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.425s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "cinder-quobyte-7f44cd2f-9415-498b-96ab-61be62d545d6" released by "delete_volume" :: held 1.208s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Deleted volume successfully. Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2488d5c5-989f-4fb6-8ada-e16fd7eaabba tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-c693aef9-e4bd-4216-a9ba-1cc967765c44-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Created reservations ['f76e1030-ad12-442d-be40-2773d7277676', '8ab5d304-de41-4f51-a2f6-30ed1415fa12', '2b790971-cf02-4ec0-866b-a06d2fd3400e', '2dff5ce4-3ec7-455b-b9c6-6875f48ad551'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:08 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b Sep 08 19:27:08 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:08 devstack sudo[101151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:08 devstack sudo[101151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:08 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b" returned: 0 in 0.570s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:08 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b Sep 08 19:27:08 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:08 devstack sudo[101151]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.377s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Deleted volume successfully. Sep 08 19:27:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9d84b588-ad86-48a4-a5b5-132fb5c35ea6 tempest-VolumesServicesTestJSON-1131721952 None] Lock "cinder-7f44cd2f-9415-498b-96ab-61be62d545d6-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:09 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daa037ee-8759-4688-9e8c-04e539c0db2b" returned: 0 in 0.359s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-quobyte-daa037ee-8759-4688-9e8c-04e539c0db2b" released by "delete_volume" :: held 1.023s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Created reservations ['f8b74e19-946f-48e2-bbcf-93301e6ef3ed', '33b0d313-8196-4c5f-b33a-f353e1e430f5', '72935b41-b3dd-402f-81a3-03bbe1f900db', '690447f4-36c1-4461-a80f-e787c26a05ed'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:09 devstack sudo[101164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:09 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:09 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.571s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:09 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Deleted volume successfully. Sep 08 19:27:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e3dc033e-e804-4c23-8e2e-5aba5c9c74ff tempest-SnapshotDependencyTests-976541803 None] Lock "cinder-daa037ee-8759-4688-9e8c-04e539c0db2b-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:15 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:15 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:15 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.397s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:27:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:27:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:27:19 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=145,cinder:SELECT=105,cinder:INSERT=44,cinder:DELETE=12 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:27:20 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=106,cinder:UPDATE=139,cinder:DELETE=14,cinder:INSERT=32 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:27:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-547ad729-d5c5-4626-836e-0a455e36aecf req-2acdb85f-55a2-4954-a66a-72d01209fce6 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-547ad729-d5c5-4626-836e-0a455e36aecf req-2acdb85f-55a2-4954-a66a-72d01209fce6 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-547ad729-d5c5-4626-836e-0a455e36aecf req-2acdb85f-55a2-4954-a66a-72d01209fce6 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-547ad729-d5c5-4626-836e-0a455e36aecf req-2acdb85f-55a2-4954-a66a-72d01209fce6 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-53e6df79-6658-4648-899a-f4f062180345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd122d241-535e-4244-9260-2f37d842f802', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:27:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-547ad729-d5c5-4626-836e-0a455e36aecf req-2acdb85f-55a2-4954-a66a-72d01209fce6 tempest-TestServerVolumeAttachmentScenario-1696631547 None] attachment_update completed successfully. Sep 08 19:27:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-f3b6bfb9-4a22-4fc8-a93a-477063f55ee2 req-ce2717df-143a-4ce0-972d-d7c451b8a80b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-f3b6bfb9-4a22-4fc8-a93a-477063f55ee2 req-ce2717df-143a-4ce0-972d-d7c451b8a80b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-f3b6bfb9-4a22-4fc8-a93a-477063f55ee2 req-ce2717df-143a-4ce0-972d-d7c451b8a80b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-f3b6bfb9-4a22-4fc8-a93a-477063f55ee2 req-ce2717df-143a-4ce0-972d-d7c451b8a80b tempest-TestServerVolumeAttachmentScenario-1696631547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-998c7dd4-3099-49b3-bd11-3342e3794f37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95e37284-d542-491d-bd2e-0786af57e6d4', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:27:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-f3b6bfb9-4a22-4fc8-a93a-477063f55ee2 req-ce2717df-143a-4ce0-972d-d7c451b8a80b tempest-TestServerVolumeAttachmentScenario-1696631547 None] attachment_update completed successfully. Sep 08 19:27:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-751b413a-25a8-4d3e-b717-c90f66ab2771 req-9f53907a-bff3-4466-9bd7-30fb05a94c4a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Terminate volume connection completed successfully. Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-751b413a-25a8-4d3e-b717-c90f66ab2771 req-9f53907a-bff3-4466-9bd7-30fb05a94c4a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Deleting attachment 95e37284-d542-491d-bd2e-0786af57e6d4. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (182eac63-edbd-456f-8abd-a028982fa069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795187d4-c505-4915-a429-8838f0b89b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795187d4-c505-4915-a429-8838f0b89b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-933359236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e2f0cf-6687-4631-983e-cfdf1c59ec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:46Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc16efe-f4f9-4ebf-aa0f-6f0489435cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc16efe-f4f9-4ebf-aa0f-6f0489435cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce1d220-2638-4591-ac86-3e1e55ee90d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce1d220-2638-4591-ac86-3e1e55ee90d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e2f0cf-6687-4631-983e-cfdf1c59ec1a', 'volume_name': 'volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fa4bae-7cee-498c-9b02-16d47e5eea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fa4bae-7cee-498c-9b02-16d47e5eea0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3b2f8c-a868-4d0e-9409-7ad3c466ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Volume 71e2f0cf-6687-4631-983e-cfdf1c59ec1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a', 'volume_size': 1} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-933359236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e2f0cf-6687-4631-983e-cfdf1c59ec1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:46Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Creating volume 71e2f0cf-6687-4631-983e-cfdf1c59ec1a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:45 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:45 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a 1073741824 Sep 08 19:27:45 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:46 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a 1073741824" returned: 0 in 0.494s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:46 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a Sep 08 19:27:46 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:46 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f3b2f8c-a868-4d0e-9409-7ad3c466ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08b544c-deaf-4af2-834e-a815698689ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Volume volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a (71e2f0cf-6687-4631-983e-cfdf1c59ec1a): created successfully Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a08b544c-deaf-4af2-834e-a815698689ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (182eac63-edbd-456f-8abd-a028982fa069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7c1946ec-b2d0-44fc-8f5c-2af652c32722 tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:27:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-4d8c65c0-fa1f-43b7-a670-a9c2b6529e7c req-ce8d9bc1-a0f3-491d-8783-cabffba5eab2 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Terminate volume connection completed successfully. Sep 08 19:27:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-4d8c65c0-fa1f-43b7-a670-a9c2b6529e7c req-ce8d9bc1-a0f3-491d-8783-cabffba5eab2 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Deleting attachment d122d241-535e-4244-9260-2f37d842f802. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:27:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5fc9f917-5576-455f-8d74-d404471ea675 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" by "attach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5fc9f917-5576-455f-8d74-d404471ea675 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" acquired by "attach_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5fc9f917-5576-455f-8d74-d404471ea675 tempest-VolumesActionsTest-1519601145 None] Attaching volume 71e2f0cf-6687-4631-983e-cfdf1c59ec1a to instance dd46a37e-7b71-4422-86f2-640233cbf428 at mountpoint /dev/vdb on host None. Sep 08 19:27:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5fc9f917-5576-455f-8d74-d404471ea675 tempest-VolumesActionsTest-1519601145 None] Attach volume completed successfully. Sep 08 19:27:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5fc9f917-5576-455f-8d74-d404471ea675 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" released by "attach_volume" :: held 0.137s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Terminate volume connection completed successfully. Sep 08 19:27:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" by "detach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Detaching volume 71e2f0cf-6687-4631-983e-cfdf1c59ec1a from instance dd46a37e-7b71-4422-86f2-640233cbf428. Sep 08 19:27:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Detach volume completed successfully. Sep 08 19:27:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e82e818b-2db7-4ce4-8a04-dc65d8a1be59 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f40a0989-9559-449a-b8c5-3e1a38854d1a tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" by "detach_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f40a0989-9559-449a-b8c5-3e1a38854d1a tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f40a0989-9559-449a-b8c5-3e1a38854d1a tempest-VolumesActionsTest-1519601145 None] Volume detach called, but volume not attached. Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f40a0989-9559-449a-b8c5-3e1a38854d1a tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-quobyte-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-quobyte-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[681b138c-8381-4f9d-a73c-8890b56b5721]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:49 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a Sep 08 19:27:49 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:50 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:50 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a Sep 08 19:27:50 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:50 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" returned: 0 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-quobyte-71e2f0cf-6687-4631-983e-cfdf1c59ec1a" released by "delete_volume" :: held 0.859s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Created reservations ['ae4b6918-5f77-49ac-a716-32a8205ec6bc', 'cc2ab4b0-d729-4f85-be3d-04dc3fb0f80b', '839c67a7-71a8-4f47-9a9c-8e93762d6d14', '21e8b986-3178-4eda-9995-78c031e05ca7'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:50 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:50 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:50 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.308s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:50 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Deleted volume successfully. Sep 08 19:27:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f77a899-7e6f-44fb-8ee5-aa1c2d57b9b9 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-71e2f0cf-6687-4631-983e-cfdf1c59ec1a-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "cinder-998c7dd4-3099-49b3-bd11-3342e3794f37-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-998c7dd4-3099-49b3-bd11-3342e3794f37-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "cinder-quobyte-998c7dd4-3099-49b3-bd11-3342e3794f37" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-quobyte-998c7dd4-3099-49b3-bd11-3342e3794f37" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[af507e09-5eff-4675-bf44-01193f4f3bad]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:53 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 Sep 08 19:27:53 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:53 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:53 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37 Sep 08 19:27:53 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:53 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-998c7dd4-3099-49b3-bd11-3342e3794f37" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-quobyte-998c7dd4-3099-49b3-bd11-3342e3794f37" released by "delete_volume" :: held 0.696s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Created reservations ['abb8a9a3-8f03-41f3-a56f-c0fcbf2cc5d6', 'ed516906-45da-4145-82ff-9e379326f98d', '74dd936d-ad68-4833-bf0a-156db8aaef80', 'db0bbd5f-cb1c-4846-b4da-f6ce6b70554e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:53 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:53 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:53 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Deleted volume successfully. Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "cinder-53e6df79-6658-4648-899a-f4f062180345-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97cc677a-bad5-4a94-a0c5-c50cf4cd5622 tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-998c7dd4-3099-49b3-bd11-3342e3794f37-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-53e6df79-6658-4648-899a-f4f062180345-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "cinder-quobyte-53e6df79-6658-4648-899a-f4f062180345" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-quobyte-53e6df79-6658-4648-899a-f4f062180345" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c475851-bfc5-48d2-8e88-09d6b7308d0a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:54 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 Sep 08 19:27:54 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (7463bde6-1e8b-41a4-9ce6-447e3469ccb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eea4b67-1735-47ed-a6b2-bf8357f67604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eea4b67-1735-47ed-a6b2-bf8357f67604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051265923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1b903d-c805-4b05-b954-6c53409f0e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:54Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736a63d0-30d0-43a2-ada7-e94cc67f8f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (736a63d0-30d0-43a2-ada7-e94cc67f8f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb26afb1-9df9-4f78-b5dc-ff8254ad06ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb26afb1-9df9-4f78-b5dc-ff8254ad06ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1b903d-c805-4b05-b954-6c53409f0e2d', 'volume_name': 'volume-2e1b903d-c805-4b05-b954-6c53409f0e2d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36cb964-2d18-41d1-97d0-24f342355477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36cb964-2d18-41d1-97d0-24f342355477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29724a00-cbd2-4a56-a78e-2ed615d36902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Volume 2e1b903d-c805-4b05-b954-6c53409f0e2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1b903d-c805-4b05-b954-6c53409f0e2d', 'volume_size': 1} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1051265923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1b903d-c805-4b05-b954-6c53409f0e2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:54Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Creating volume 2e1b903d-c805-4b05-b954-6c53409f0e2d {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:54 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:54 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d 1073741824 Sep 08 19:27:54 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:54 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:54 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345 Sep 08 19:27:54 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:54 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d 1073741824" returned: 0 in 0.406s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:54 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-53e6df79-6658-4648-899a-f4f062180345" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-quobyte-53e6df79-6658-4648-899a-f4f062180345" released by "delete_volume" :: held 0.703s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:54 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d Sep 08 19:27:54 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Created reservations ['d5869e60-a0ea-4d89-95eb-f7a6d50d2134', '307ab7f8-3c05-4475-9ee3-b3b9899dc909', 'af95c286-ff46-4a86-abeb-04304bf104d5', '5fe16bbf-cd4c-4148-abcd-392c396f79d3'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:54 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:54 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:55 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d" returned: 0 in 0.253s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29724a00-cbd2-4a56-a78e-2ed615d36902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1b903d-c805-4b05-b954-6c53409f0e2d', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0519c96c-1a3a-41fb-869a-c4803797ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Volume volume-2e1b903d-c805-4b05-b954-6c53409f0e2d (2e1b903d-c805-4b05-b954-6c53409f0e2d): created successfully Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0519c96c-1a3a-41fb-869a-c4803797ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (7463bde6-1e8b-41a4-9ce6-447e3469ccb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e19e3e9f-c3dc-43c9-9e1d-c3bb605cc613 tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:27:55 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Deleted volume successfully. Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-75e09cd8-5d1a-413a-80d3-bc289107d15a tempest-TestServerVolumeAttachmentScenario-1696631547 None] Lock "cinder-53e6df79-6658-4648-899a-f4f062180345-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-2e1b903d-c805-4b05-b954-6c53409f0e2d-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "cinder-2e1b903d-c805-4b05-b954-6c53409f0e2d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-quobyte-2e1b903d-c805-4b05-b954-6c53409f0e2d" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-2e1b903d-c805-4b05-b954-6c53409f0e2d" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd50734-35d6-472c-9a77-ec5614f4b3c8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:55 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d Sep 08 19:27:55 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:55 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d" returned: 0 in 0.366s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:55 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d Sep 08 19:27:55 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:56 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e1b903d-c805-4b05-b954-6c53409f0e2d" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-2e1b903d-c805-4b05-b954-6c53409f0e2d" released by "delete_volume" :: held 0.665s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Created reservations ['14e11deb-5663-4c51-8f0e-d544eb02b61c', 'c862bab0-73a9-40d5-bb0f-c33302ecb0f5', '74a3b095-2e2b-4cc0-8b72-b9a5dac24adc', '783dd0f6-6841-4dee-bd65-6df9a35251ac'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:56 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:56 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:56 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.276s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Deleted volume successfully. Sep 08 19:27:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ed02fb83-91b9-41ef-9ed2-82938f3e3c5f tempest-VolumesActionsTest-1630679632 None] Lock "cinder-2e1b903d-c805-4b05-b954-6c53409f0e2d-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (3b189ec0-d891-4cc0-bdaf-3a3c59b01209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38297f0c-e9d4-4d18-a060-fd4fe526f12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38297f0c-e9d4-4d18-a060-fd4fe526f12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536602792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6723bacc-d3a0-4b79-9f24-8a7a5d00d59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:57Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a867f11-03c9-4c82-9313-01115b83548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a867f11-03c9-4c82-9313-01115b83548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5d1e5-3b34-4976-a790-01a6c6ecf4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b5d1e5-3b34-4976-a790-01a6c6ecf4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6723bacc-d3a0-4b79-9f24-8a7a5d00d59a', 'volume_name': 'volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c958dd-ade6-4b06-95a4-dd45f1a62016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c958dd-ade6-4b06-95a4-dd45f1a62016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772740b8-ced0-4cdc-a18b-57fd32df4782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Volume 6723bacc-d3a0-4b79-9f24-8a7a5d00d59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a', 'volume_size': 1} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-536602792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6723bacc-d3a0-4b79-9f24-8a7a5d00d59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:27:57Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Creating volume 6723bacc-d3a0-4b79-9f24-8a7a5d00d59a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:27:57 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:57 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a 1073741824 Sep 08 19:27:57 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:57 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a 1073741824" returned: 0 in 0.438s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:57 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a Sep 08 19:27:57 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:57 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772740b8-ced0-4cdc-a18b-57fd32df4782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236ddd2f-bf4d-4e5e-8b55-ff1e667d7c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:27:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Volume volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a (6723bacc-d3a0-4b79-9f24-8a7a5d00d59a): created successfully Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236ddd2f-bf4d-4e5e-8b55-ff1e667d7c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:27:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (3b189ec0-d891-4cc0-bdaf-3a3c59b01209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:27:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-91b4b6a9-15ed-4820-b781-27587bc52a0e tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "cinder-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-quobyte-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" acquired by "delete_volume" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a007fb28-4cf2-4c96-8264-71f61ef39a5b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:58 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a Sep 08 19:27:58 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:58 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" returned: 0 in 0.429s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:58 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a Sep 08 19:27:58 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:59 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a" released by "delete_volume" :: held 0.726s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Created reservations ['ca801665-aef7-489d-b72c-efbed2e13cf2', '00bc3ef4-95ec-4e92-9498-d0ab509d8708', 'c208c57d-54a6-4735-bd08-da0e8226003e', 'ee4ff6a9-8f8a-410a-8120-bde1c8a78b39'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:27:59 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:27:59 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:27:59 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.298s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:27:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Deleted volume successfully. Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8071a84d-2e57-456f-83c8-d379085869bd tempest-VolumesActionsTest-1630679632 None] Lock "cinder-6723bacc-d3a0-4b79-9f24-8a7a5d00d59a-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:27:59 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (7875441b-24a4-4c5f-9c27-de54ddf19b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1b9cc3-1e5f-4bed-aa39-8aa3400da29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b1b9cc3-1e5f-4bed-aa39-8aa3400da29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1876121288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167eeab6-6024-412d-8ea4-cdf9b8c82fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:00Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961f0b9d-0f45-44ea-bc5b-2c8763dc89fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961f0b9d-0f45-44ea-bc5b-2c8763dc89fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d15726-4136-4a84-844e-6ec39c9fb140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d15726-4136-4a84-844e-6ec39c9fb140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167eeab6-6024-412d-8ea4-cdf9b8c82fda', 'volume_name': 'volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418fa5b-fd7e-45c1-a86f-878cba0686c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c418fa5b-fd7e-45c1-a86f-878cba0686c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acb82c1-deb5-448f-ae2e-bb818e60d5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Volume 167eeab6-6024-412d-8ea4-cdf9b8c82fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda', 'volume_size': 1} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1876121288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167eeab6-6024-412d-8ea4-cdf9b8c82fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:00Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Creating volume 167eeab6-6024-412d-8ea4-cdf9b8c82fda {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:00 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:00 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda 1073741824 Sep 08 19:28:00 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:00 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda 1073741824" returned: 0 in 0.471s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:00 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda Sep 08 19:28:00 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:00 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4acb82c1-deb5-448f-ae2e-bb818e60d5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f90624-03da-43af-a71b-a3c28cddc784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Volume volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda (167eeab6-6024-412d-8ea4-cdf9b8c82fda): created successfully Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f90624-03da-43af-a71b-a3c28cddc784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (7875441b-24a4-4c5f-9c27-de54ddf19b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ea3e63c8-d41c-4a21-a36e-1f0b72013130 tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-167eeab6-6024-412d-8ea4-cdf9b8c82fda-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-167eeab6-6024-412d-8ea4-cdf9b8c82fda-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-quobyte-167eeab6-6024-412d-8ea4-cdf9b8c82fda" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-167eeab6-6024-412d-8ea4-cdf9b8c82fda" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a79582-51b1-46b9-927a-fd0cfb40c3a6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:01 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda Sep 08 19:28:01 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:01 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda" returned: 0 in 0.373s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:01 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda Sep 08 19:28:01 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:01 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-167eeab6-6024-412d-8ea4-cdf9b8c82fda" returned: 0 in 0.284s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-167eeab6-6024-412d-8ea4-cdf9b8c82fda" released by "delete_volume" :: held 0.703s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Created reservations ['efdabc77-61b0-438c-bd50-c71c9e233688', '6553805c-7d06-493f-95f7-13bde3e19bf6', '74a89580-a45d-4400-8284-9a53d73ad883', '401bf405-1937-46a1-8448-3940d9453c33'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:02 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:02 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:02 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Deleted volume successfully. Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ffa74f4e-065f-4322-b991-b0eda5343d40 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-167eeab6-6024-412d-8ea4-cdf9b8c82fda-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (b140badd-d1d2-4a57-98f6-9a44cc343771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dccd82-0b01-4b41-b766-207e7e6c7be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96dccd82-0b01-4b41-b766-207e7e6c7be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104507260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ada7d9-23eb-440d-9802-066ecec301de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:03Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e535f4bb-3f19-4096-a9d8-4f634896b3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e535f4bb-3f19-4096-a9d8-4f634896b3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56578d7-0c63-48eb-ba37-ffbb1a645a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56578d7-0c63-48eb-ba37-ffbb1a645a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46ada7d9-23eb-440d-9802-066ecec301de', 'volume_name': 'volume-46ada7d9-23eb-440d-9802-066ecec301de', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419d5b78-28c3-4b16-9372-1a83d85ec5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419d5b78-28c3-4b16-9372-1a83d85ec5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5646172-3638-4980-aca9-744265ef5711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Volume 46ada7d9-23eb-440d-9802-066ecec301de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46ada7d9-23eb-440d-9802-066ecec301de', 'volume_size': 1} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2104507260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46ada7d9-23eb-440d-9802-066ecec301de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:03Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Creating volume 46ada7d9-23eb-440d-9802-066ecec301de {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:03 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:03 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de 1073741824 Sep 08 19:28:03 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:03 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de 1073741824" returned: 0 in 0.463s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:03 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de Sep 08 19:28:03 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:03 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5646172-3638-4980-aca9-744265ef5711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46ada7d9-23eb-440d-9802-066ecec301de', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8fcb99-cca1-4886-8a7d-edbce67558fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Volume volume-46ada7d9-23eb-440d-9802-066ecec301de (46ada7d9-23eb-440d-9802-066ecec301de): created successfully Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8fcb99-cca1-4886-8a7d-edbce67558fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (b140badd-d1d2-4a57-98f6-9a44cc343771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-90e83c82-98ae-458d-9c18-93cd18639cf8 tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-46ada7d9-23eb-440d-9802-066ecec301de-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-46ada7d9-23eb-440d-9802-066ecec301de-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "cinder-quobyte-46ada7d9-23eb-440d-9802-066ecec301de" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-46ada7d9-23eb-440d-9802-066ecec301de" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5353558-8303-49d4-932b-bddfd931d23d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:05 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de Sep 08 19:28:05 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:05 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:05 devstack sudo[102009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de Sep 08 19:28:05 devstack sudo[102009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:05 devstack sudo[102009]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-46ada7d9-23eb-440d-9802-066ecec301de" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-quobyte-46ada7d9-23eb-440d-9802-066ecec301de" released by "delete_volume" :: held 0.670s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Created reservations ['63fd71f6-7050-47d2-a7be-f7d07a24fb24', 'e68a063b-fbc6-4998-ac87-d3213502aa77', '7e8c3ad8-42aa-449d-aeb1-0464b796673a', 'e891276a-ccd3-46d4-9b87-97dcad729e8d'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:06 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:06 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:06 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Deleted volume successfully. Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b65fb89a-5182-4fb1-adb6-82f694754b88 tempest-VolumesActionsTest-1630679632 None] Lock "cinder-46ada7d9-23eb-440d-9802-066ecec301de-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (e89a827a-c970-4448-8403-8363df765c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe7a507-0821-4536-96c2-b5d323f34778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe7a507-0821-4536-96c2-b5d323f34778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1332852915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295f3576-bec2-4f7b-be1a-e051debd7db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:07Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb44b5-08c8-4447-9345-7dd86b3e4abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb44b5-08c8-4447-9345-7dd86b3e4abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4a46e4-ef11-4e44-b03a-24f2ee135119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a4a46e4-ef11-4e44-b03a-24f2ee135119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '295f3576-bec2-4f7b-be1a-e051debd7db3', 'volume_name': 'volume-295f3576-bec2-4f7b-be1a-e051debd7db3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1328e7-1f79-468b-bc0d-f0f99af2be56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b1328e7-1f79-468b-bc0d-f0f99af2be56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca2b7e7-2572-456b-a271-482f0da083d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:06 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Volume 295f3576-bec2-4f7b-be1a-e051debd7db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-295f3576-bec2-4f7b-be1a-e051debd7db3', 'volume_size': 1} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1332852915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295f3576-bec2-4f7b-be1a-e051debd7db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e11bc1c77084901a5d089c4088878e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:07Z,use_quota=True,user_id='2b266e77dbaf47f18bbab82028b102bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Creating volume 295f3576-bec2-4f7b-be1a-e051debd7db3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:06 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:06 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 1073741824 Sep 08 19:28:06 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:07 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 1073741824" returned: 0 in 0.455s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:07 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 Sep 08 19:28:07 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:07 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca2b7e7-2572-456b-a271-482f0da083d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295f3576-bec2-4f7b-be1a-e051debd7db3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17ed14a-e8f7-4190-bb6b-c28bb4c0c150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:07 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Volume volume-295f3576-bec2-4f7b-be1a-e051debd7db3 (295f3576-bec2-4f7b-be1a-e051debd7db3): created successfully Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17ed14a-e8f7-4190-bb6b-c28bb4c0c150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Flow 'volume_create_manager' (e89a827a-c970-4448-8403-8363df765c03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5e0580c1-74ba-463c-9a07-7fa6d2ae9665 tempest-VolumesActionsTest-1519601145 None] Created volume successfully. Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-295f3576-bec2-4f7b-be1a-e051debd7db3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-295f3576-bec2-4f7b-be1a-e051debd7db3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "cinder-quobyte-295f3576-bec2-4f7b-be1a-e051debd7db3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-quobyte-295f3576-bec2-4f7b-be1a-e051debd7db3" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a1e7ec-499f-4cbb-9472-34ea7d7cd25b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:09 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 Sep 08 19:28:09 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:09 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:10 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3 Sep 08 19:28:10 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:10 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-295f3576-bec2-4f7b-be1a-e051debd7db3" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-quobyte-295f3576-bec2-4f7b-be1a-e051debd7db3" released by "delete_volume" :: held 0.680s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Created reservations ['f48dc442-6cb7-425e-bd52-47085a91fb61', '846536a4-845c-42f4-8462-024115a1c0e9', '85a0c2a9-6b58-4790-baf3-522348a5509e', '08931449-16d6-4970-b774-ab24a96b2768'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:10 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:10 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:10 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Deleted volume successfully. Sep 08 19:28:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-97151956-f2d5-4071-9316-fe973eca8de6 tempest-VolumesActionsTest-1519601145 None] Lock "cinder-295f3576-bec2-4f7b-be1a-e051debd7db3-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:15 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:15 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:15 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:28:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:28:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:28:20 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=78,cinder:UPDATE=90,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:28:20 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=72,cinder:UPDATE=88,cinder:DELETE=10,cinder:INSERT=20 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:28:29 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Flow 'volume_create_manager' (14f07792-7e79-4d7e-9c4d-ad60f76c5561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:29 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e0a5a6-a813-42db-8d18-618cae7da15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e0a5a6-a813-42db-8d18-618cae7da15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2038624522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9dfd2b-364e-4415-8808-1e90888d45ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c399b052f734aca9f0c10d14767efe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:30Z,use_quota=True,user_id='3fccc232372743c3b1046d7041c5c1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca86c21c-8203-4771-881f-c57d4eb99015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca86c21c-8203-4771-881f-c57d4eb99015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0330b8-4c70-44c6-a716-e26ed5e52260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0330b8-4c70-44c6-a716-e26ed5e52260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9dfd2b-364e-4415-8808-1e90888d45ba', 'volume_name': 'volume-dd9dfd2b-364e-4415-8808-1e90888d45ba', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f29d737-a7fd-4a7b-a082-90c19bfbb0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f29d737-a7fd-4a7b-a082-90c19bfbb0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3314345e-433b-461f-8671-638675ca3e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Volume dd9dfd2b-364e-4415-8808-1e90888d45ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9dfd2b-364e-4415-8808-1e90888d45ba', 'volume_size': 1} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2038624522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9dfd2b-364e-4415-8808-1e90888d45ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c399b052f734aca9f0c10d14767efe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:30Z,use_quota=True,user_id='3fccc232372743c3b1046d7041c5c1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Creating volume dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:30 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba 1073741824 Sep 08 19:28:30 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:30 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba 1073741824" returned: 0 in 0.500s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:30 devstack sudo[102055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:28:30 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:30 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.314s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3314345e-433b-461f-8671-638675ca3e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9dfd2b-364e-4415-8808-1e90888d45ba', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4254b727-bf1c-45e2-8cf8-94369d1dd5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Volume volume-dd9dfd2b-364e-4415-8808-1e90888d45ba (dd9dfd2b-364e-4415-8808-1e90888d45ba): created successfully Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4254b727-bf1c-45e2-8cf8-94369d1dd5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Flow 'volume_create_manager' (14f07792-7e79-4d7e-9c4d-ad60f76c5561) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7ebcbbbb-bee3-467a-b407-51f2f521a6af tempest-TestStampPattern-1323443948 None] Created volume successfully. Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Flow 'volume_create_manager' (5c04f2ac-2ba6-4d57-b4bf-8087b36f167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c0e2c-b83d-44ba-960a-6bd8fdd68c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26c0e2c-b83d-44ba-960a-6bd8fdd68c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1875151317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d55edb-3ecb-42ac-a7fa-86ad697077b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af8e6970a34d308cef738f4d1d7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:32Z,use_quota=True,user_id='8ad5f71198594a2c840859ed293cec76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe8faf3-15db-4785-8b54-33cd1aa56f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe8faf3-15db-4785-8b54-33cd1aa56f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b21002a-fb36-4cae-945f-058e6deb5d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b21002a-fb36-4cae-945f-058e6deb5d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d55edb-3ecb-42ac-a7fa-86ad697077b2', 'volume_name': 'volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5fa08b-5795-472a-a925-2de413a5b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b5fa08b-5795-472a-a925-2de413a5b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6339ce7c-d24a-4192-b554-cb1d0f3f92aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Volume 22d55edb-3ecb-42ac-a7fa-86ad697077b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2', 'volume_size': 1} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1875151317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d55edb-3ecb-42ac-a7fa-86ad697077b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33af8e6970a34d308cef738f4d1d7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:32Z,use_quota=True,user_id='8ad5f71198594a2c840859ed293cec76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Creating volume 22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:32 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:32 devstack sudo[102061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 1073741824 Sep 08 19:28:32 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:32 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 1073741824" returned: 0 in 0.497s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:32 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 Sep 08 19:28:32 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:33 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6339ce7c-d24a-4192-b554-cb1d0f3f92aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a98b22-656c-4251-9399-fb78ff7f8cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:33 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Volume volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 (22d55edb-3ecb-42ac-a7fa-86ad697077b2): created successfully Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22a98b22-656c-4251-9399-fb78ff7f8cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Flow 'volume_create_manager' (5c04f2ac-2ba6-4d57-b4bf-8087b36f167e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-45e11174-ec6a-4c9f-a39b-5b963af157e6 tempest-SnapshotMetadataTestJSON-948829899 None] Created volume successfully. Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Creating offline snapshot 7894594b-680f-4bbd-8948-79b156876bfa of volume 22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5712265e-f749-4542-8650-b6fed4d02285]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:34 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 Sep 08 19:28:34 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:34 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2" returned: 0 in 0.557s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:34 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa 1G Sep 08 19:28:34 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:35 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa 1G" returned: 0 in 0.745s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:35 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa Sep 08 19:28:35 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:36 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:36 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa is being set with open permissions: ugo+rw Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:36 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa Sep 08 19:28:36 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:36 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:36 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info Sep 08 19:28:36 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:36 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:36 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info is being set with open permissions: ugo+rw Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:36 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info Sep 08 19:28:36 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:36 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.info" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-dec0694d-b3ef-4b92-b318-ce19a3598943 tempest-SnapshotMetadataTestJSON-948829899 None] Create snapshot completed successfully Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "cinder-7894594b-680f-4bbd-8948-79b156876bfa-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-7894594b-680f-4bbd-8948-79b156876bfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "cinder-quobyte-7894594b-680f-4bbd-8948-79b156876bfa" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-7894594b-680f-4bbd-8948-79b156876bfa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Deleting offline snapshot 7894594b-680f-4bbd-8948-79b156876bfa of volume 22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] snapshot_file for this snap is: volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e04deec-b932-4692-8897-d9744a663281]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:38 devstack sudo[102179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa Sep 08 19:28:38 devstack sudo[102179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:38 devstack sudo[102179]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa" returned: 0 in 0.388s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11472f-3c32-46e2-b76c-8533d0de467e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:38 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 Sep 08 19:28:38 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:39 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2" returned: 0 in 0.407s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:39 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa Sep 08 19:28:39 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:39 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:39 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa Sep 08 19:28:39 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:39 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2.7894594b-680f-4bbd-8948-79b156876bfa" returned: 0 in 0.269s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-7894594b-680f-4bbd-8948-79b156876bfa" released by "_delete_snapshot" :: held 1.559s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" released by "delete_snapshot" :: held 1.587s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Created reservations ['aacc81c3-f70a-4478-8822-f5f51dc13a1d', 'b53953fe-7252-4654-ac47-6a04b45fda7c', '50679857-8645-42df-bf20-0a2dc78d0220', '28374d72-d3f4-4538-8673-e1046ee72ab5'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Delete snapshot completed successfully. Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ee406c69-ce97-49b2-9532-25d7652756b8 tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-7894594b-680f-4bbd-8948-79b156876bfa-delete_snapshot" released by "delete_snapshot" :: held 1.754s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "cinder-22d55edb-3ecb-42ac-a7fa-86ad697077b2-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-22d55edb-3ecb-42ac-a7fa-86ad697077b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aa0202-bfbd-4ebb-9a42-1cfb26a6f6e4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:40 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 Sep 08 19:28:40 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:41 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2" returned: 0 in 0.371s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:41 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2 Sep 08 19:28:41 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:41 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-22d55edb-3ecb-42ac-a7fa-86ad697077b2" returned: 0 in 0.282s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-quobyte-22d55edb-3ecb-42ac-a7fa-86ad697077b2" released by "delete_volume" :: held 0.720s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Created reservations ['51f0c2fc-17a7-4bce-b336-6739b692e4c2', '987dae9b-e2d6-42e2-98ef-7c7ffcab0dd8', 'c72a1db3-821e-4aa9-ac88-001ec48dad6d', '158e1837-d336-44c8-98e3-4251784cca17'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:41 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:41 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:41 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Deleted volume successfully. Sep 08 19:28:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f3f16e94-17bc-40f2-a18e-7cef92d3423d tempest-SnapshotMetadataTestJSON-948829899 None] Lock "cinder-22d55edb-3ecb-42ac-a7fa-86ad697077b2-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Flow 'volume_create_manager' (ac0db09f-67b8-4414-b25f-5f92b4fa1ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e879f67-b2c9-45b0-a2d7-8b954cf0d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e879f67-b2c9-45b0-a2d7-8b954cf0d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1622456695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd84076-3095-4499-b3fa-762719380e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956cd7c5928b4fedb8a6e46cb262ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:47Z,use_quota=True,user_id='9690c804f08b4cdea75dc81c0f8653bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effbfa86-83a5-4281-878c-fd5d63998edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effbfa86-83a5-4281-878c-fd5d63998edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c389a4-a0a5-4158-b522-23c80d42aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c389a4-a0a5-4158-b522-23c80d42aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd84076-3095-4499-b3fa-762719380e14', 'volume_name': 'volume-bfd84076-3095-4499-b3fa-762719380e14', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0867c8-d72a-4136-b4aa-9545e0bda901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b0867c8-d72a-4136-b4aa-9545e0bda901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6373ca2-b6b1-4df3-ad23-bccc28c2485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Volume bfd84076-3095-4499-b3fa-762719380e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd84076-3095-4499-b3fa-762719380e14', 'volume_size': 1} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1622456695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd84076-3095-4499-b3fa-762719380e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956cd7c5928b4fedb8a6e46cb262ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:47Z,use_quota=True,user_id='9690c804f08b4cdea75dc81c0f8653bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Creating volume bfd84076-3095-4499-b3fa-762719380e14 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:46 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:46 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 1073741824 Sep 08 19:28:46 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:47 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 1073741824" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:47 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 Sep 08 19:28:47 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:47 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6373ca2-b6b1-4df3-ad23-bccc28c2485a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd84076-3095-4499-b3fa-762719380e14', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c73107-cdb1-4e8d-804c-c1e0cd27328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:47 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Volume volume-bfd84076-3095-4499-b3fa-762719380e14 (bfd84076-3095-4499-b3fa-762719380e14): created successfully Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c73107-cdb1-4e8d-804c-c1e0cd27328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Flow 'volume_create_manager' (ac0db09f-67b8-4414-b25f-5f92b4fa1ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d9b3624c-592c-45fb-aef1-4f6e36cd0e91 tempest-VolumesTransfersV357Test-368923385 None] Created volume successfully. Sep 08 19:28:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8bc7a368-0653-4905-8c64-d1f2ebe2bc33 tempest-VolumesTransfersV357Test-547131423 None] Transfer volume completed successfully. Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "cinder-bfd84076-3095-4499-b3fa-762719380e14-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-bfd84076-3095-4499-b3fa-762719380e14-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "cinder-quobyte-bfd84076-3095-4499-b3fa-762719380e14" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-quobyte-bfd84076-3095-4499-b3fa-762719380e14" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ef5698-324b-4e5a-a4ec-19a560aedee0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:49 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 Sep 08 19:28:49 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:49 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:49 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14 Sep 08 19:28:49 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:49 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-bfd84076-3095-4499-b3fa-762719380e14" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-quobyte-bfd84076-3095-4499-b3fa-762719380e14" released by "delete_volume" :: held 0.636s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Created reservations ['51abb40d-c478-4eda-ad9d-19473418d524', '7cf879c4-b5a9-4057-bc91-21f4584aab21', '2a856d5c-5469-4cf7-b474-ee2be0a9292c', '2899bae6-2688-4f10-912e-929d0f869a81'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:49 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:49 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:50 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Deleted volume successfully. Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a339e28f-1d6b-465e-9d2d-306999899484 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-bfd84076-3095-4499-b3fa-762719380e14-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Flow 'volume_create_manager' (51684017-4d49-4f6a-a766-96fee76036be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde3b29b-6932-4054-b881-2b8e970c42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde3b29b-6932-4054-b881-2b8e970c42db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475724317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956cd7c5928b4fedb8a6e46cb262ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:51Z,use_quota=True,user_id='9690c804f08b4cdea75dc81c0f8653bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f75296-0985-403e-9df1-b930ac790d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f75296-0985-403e-9df1-b930ac790d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06207b8-e13a-4dcc-b577-6e87a4a44ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e06207b8-e13a-4dcc-b577-6e87a4a44ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8', 'volume_name': 'volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5716d2-587a-4a21-b49d-c7d1c6dec89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab5716d2-587a-4a21-b49d-c7d1c6dec89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aac7168-bde7-4b92-a06b-3cc9abe1679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Volume a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8', 'volume_size': 1} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-475724317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956cd7c5928b4fedb8a6e46cb262ad0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:51Z,use_quota=True,user_id='9690c804f08b4cdea75dc81c0f8653bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Creating volume a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:50 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:50 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 1073741824 Sep 08 19:28:50 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:51 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 1073741824" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:51 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 Sep 08 19:28:51 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:51 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aac7168-bde7-4b92-a06b-3cc9abe1679e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c44b06-c3c1-4718-bad4-36aa3c68531c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Volume volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 (a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8): created successfully Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c44b06-c3c1-4718-bad4-36aa3c68531c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Flow 'volume_create_manager' (51684017-4d49-4f6a-a766-96fee76036be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-826fc608-dde9-451f-a080-be0be520d100 tempest-VolumesTransfersV357Test-368923385 None] Created volume successfully. Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "cinder-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "cinder-quobyte-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-quobyte-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f571e-f594-4660-a1c7-1fdd432b272a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:52 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 Sep 08 19:28:52 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:52 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:52 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8 Sep 08 19:28:52 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:52 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-quobyte-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8" released by "delete_volume" :: held 0.632s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Created reservations ['f2cc4a89-dac2-47d2-939a-fc00974d32df', '5696f2e4-5f9b-42c2-88d9-00ca2fea63aa', '305f6772-f905-4769-b93f-6b64c024223f', '14e87a09-3c25-4fdd-8a66-d7209ccdf575'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:52 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:28:52 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:53 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.247s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:53 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:28:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Deleted volume successfully. Sep 08 19:28:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-237c068a-7846-48ea-ab51-bdaf1a82e183 tempest-VolumesTransfersV357Test-1809549640 None] Lock "cinder-a5e5b1b7-ffba-4baa-8b0e-10864b5ef2c8-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Flow 'volume_create_manager' (6ef1d2bf-734b-4318-b74c-8012bea09d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da259ce-f520-46d3-a4e5-5aa4f6a85b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da259ce-f520-46d3-a4e5-5aa4f6a85b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1110062431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa7e007-6a6f-4b73-9022-a8bd056f186b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30903adbec4a829f0a9845968ae049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:59Z,use_quota=True,user_id='c19509926ac54399adbfa0b26217214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343cb80c-cfe0-4fae-a901-b9abaf10b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (343cb80c-cfe0-4fae-a901-b9abaf10b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f294488-2ecf-401e-be87-8342d8ba4c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f294488-2ecf-401e-be87-8342d8ba4c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'volume_name': 'volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e09c472-8fad-450a-a1f8-4da4c8845429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e09c472-8fad-450a-a1f8-4da4c8845429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9ee713-446b-40d9-9036-a0f6bcd4e230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:58 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Volume 8fa7e007-6a6f-4b73-9022-a8bd056f186b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'volume_size': 1} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1110062431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fa7e007-6a6f-4b73-9022-a8bd056f186b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30903adbec4a829f0a9845968ae049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:28:59Z,use_quota=True,user_id='c19509926ac54399adbfa0b26217214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Creating volume 8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:28:58 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:28:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:58 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b 1073741824 Sep 08 19:28:58 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:59 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b 1073741824" returned: 0 in 0.399s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:28:59 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:28:59 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:28:59 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.234s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9ee713-446b-40d9-9036-a0f6bcd4e230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef7beb7-e01a-42c1-ad4d-c135ee167003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:28:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Volume volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b (8fa7e007-6a6f-4b73-9022-a8bd056f186b): created successfully Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef7beb7-e01a-42c1-ad4d-c135ee167003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:28:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Flow 'volume_create_manager' (6ef1d2bf-734b-4318-b74c-8012bea09d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:28:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-51406f6b-38c2-4aec-9a9e-b8c96ed424e2 tempest-VolumesCloneTest-747726 None] Created volume successfully. Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Flow 'volume_create_manager' (2354fbae-a20c-44e0-9412-834c42fe4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f39c898-6f47-4147-8eb6-7436e324c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f39c898-6f47-4147-8eb6-7436e324c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-371624506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff30903adbec4a829f0a9845968ae049',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8fa7e007-6a6f-4b73-9022-a8bd056f186b,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:00Z,use_quota=True,user_id='c19509926ac54399adbfa0b26217214e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3605a6c-6919-4233-9487-1734247fa302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3605a6c-6919-4233-9487-1734247fa302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b4a9fa-5f3f-4db5-8b80-efb9f2bbe438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b4a9fa-5f3f-4db5-8b80-efb9f2bbe438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1', 'volume_name': 'volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1', 'volume_size': 2, 'source_volid': '8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'source_volstatus': 'available'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8af3f14-4bd2-4fc4-9b38-fa75b2de4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8af3f14-4bd2-4fc4-9b38-fa75b2de4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5d1a90-8906-4f58-bc69-bc3de132be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Volume 3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1', 'volume_size': 2, 'source_volid': '8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'source_volstatus': 'available'} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:00 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Cloning volume 8fa7e007-6a6f-4b73-9022-a8bd056f186b to volume 3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Creating offline snapshot b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 of volume 8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[046875e1-1f00-4ed5-baed-503e752ac14e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b0529645-254e-4bb4-986e-558896551e41 req-e8333014-a8bc-415e-99be-b611a44bfd6e tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:00 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:29:00 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:01 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.349s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:01 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 1G Sep 08 19:29:01 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:01 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 1G" returned: 0 in 0.380s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:01 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:01 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:01 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.300s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:01 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 is being set with open permissions: ugo+rw Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:01 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:01 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:01 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:02 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info Sep 08 19:29:02 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:02 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:02 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info is being set with open permissions: ugo+rw Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:02 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info Sep 08 19:29:02 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:02 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.info" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] snapshot: b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966, volume: 3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbadb2b-205b-4244-bdc9-32d40dab9f55]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:02 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:02 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:02 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.348s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb80509-fcc7-4ad8-b6f5-5c6bc92ff6a6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:03 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:29:03 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:03 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.338s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:29:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:29:03 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:29:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:03 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 Sep 08 19:29:03 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:07 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" returned: 0 in 4.066s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:29:07 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Converted 1024.00 MB image at 251.75 MB/s Sep 08 19:29:07 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 is being set with open permissions: ugo+rw Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:07 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 Sep 08 19:29:07 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:07 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" released by "_copy_volume_from_snapshot" :: held 5.055s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-quobyte-b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Deleting offline snapshot b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 of volume 8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] snapshot_file for this snap is: volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[664eb474-323f-427a-9d5f-01baf2a629a1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:07 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:07 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:07 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaa4838-05d6-4366-8ff8-8764a275d0d7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:08 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:29:08 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:08 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.527s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:08 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:08 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:08 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.324s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:08 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966 Sep 08 19:29:08 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:09 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b.b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-b9f8a2a5-bbd3-4ff5-aa95-a807c26b6966" released by "_delete_snapshot" :: held 1.531s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.545s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b0529645-254e-4bb4-986e-558896551e41 req-e8333014-a8bc-415e-99be-b611a44bfd6e tempest-TestStampPattern-1323443948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.466s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-b0529645-254e-4bb4-986e-558896551e41 req-e8333014-a8bc-415e-99be-b611a44bfd6e tempest-TestStampPattern-1323443948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5d1a90-8906-4f58-bc69-bc3de132be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1', 'volume_size': 2, 'source_volid': '8fa7e007-6a6f-4b73-9022-a8bd056f186b', 'source_volstatus': 'available'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c363c49e-069a-428b-a371-8f9af4a913a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:09 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Volume volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 (3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1): created successfully Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c363c49e-069a-428b-a371-8f9af4a913a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Flow 'volume_create_manager' (2354fbae-a20c-44e0-9412-834c42fe4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-b0529645-254e-4bb4-986e-558896551e41 req-e8333014-a8bc-415e-99be-b611a44bfd6e tempest-TestStampPattern-1323443948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-dd9dfd2b-364e-4415-8808-1e90888d45ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd246a945-a16d-4730-a27c-15b239297b24', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:29:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bd1a7bfa-0f66-4396-a93d-42735cd8b09d tempest-VolumesCloneTest-747726 None] Created volume successfully. Sep 08 19:29:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-b0529645-254e-4bb4-986e-558896551e41 req-e8333014-a8bc-415e-99be-b611a44bfd6e tempest-TestStampPattern-1323443948 None] attachment_update completed successfully. Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "cinder-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881adae-3d03-4686-a7c2-2e07eb427c97]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:10 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 Sep 08 19:29:10 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:10 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:10 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1 Sep 08 19:29:10 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:10 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1" released by "delete_volume" :: held 0.660s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Created reservations ['2143c896-b201-4335-afae-2859a961739e', 'd6df6abb-b594-4154-913e-f252a6e56215', '52e557ff-155f-47e6-aff1-8bd762b89990', '4e019347-9d4c-4900-9aea-b6b5e9cdafac'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:11 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:11 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:11 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Deleted volume successfully. Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-74abfdea-fe70-4db5-a2b4-522f4afd5e29 tempest-VolumesCloneTest-747726 None] Lock "cinder-3e5d4fa6-5d1f-4e3d-bfc3-84d85eb9fbc1-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-8fa7e007-6a6f-4b73-9022-a8bd056f186b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "cinder-8fa7e007-6a6f-4b73-9022-a8bd056f186b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Acquiring lock "cinder-quobyte-8fa7e007-6a6f-4b73-9022-a8bd056f186b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-8fa7e007-6a6f-4b73-9022-a8bd056f186b" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bca62c-20bd-4a54-b981-936fa2852b1a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:11 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:29:11 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:11 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.379s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:12 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b Sep 08 19:29:12 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:12 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8fa7e007-6a6f-4b73-9022-a8bd056f186b" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "cinder-quobyte-8fa7e007-6a6f-4b73-9022-a8bd056f186b" released by "delete_volume" :: held 0.696s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Created reservations ['b1b8859f-3448-4a0a-b8b1-e4f0b3a5d6c2', '36150954-2c5a-455a-9c60-f8765202d5e6', 'bb67c104-34c2-491a-b955-6c9b13206da3', '887e7223-09b0-458e-9569-2b1ce94607ed'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:12 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:12 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:12 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.280s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Deleted volume successfully. Sep 08 19:29:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c6373ddd-a710-42dd-90b4-1ce38c964caf tempest-VolumesCloneTest-747726 None] Lock "cinder-8fa7e007-6a6f-4b73-9022-a8bd056f186b-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-be0fa7f1-5e02-494e-b0b6-b23ee4112adf req-ddc87005-8ead-4f8d-b72c-cb5c9946f125 tempest-TestStampPattern-1323443948 None] Terminate volume connection completed successfully. Sep 08 19:29:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-be0fa7f1-5e02-494e-b0b6-b23ee4112adf req-ddc87005-8ead-4f8d-b72c-cb5c9946f125 tempest-TestStampPattern-1323443948 None] Deleting attachment d246a945-a16d-4730-a27c-15b239297b24. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Creating offline snapshot d1f8ecc7-e3f2-464c-9014-1eaedce9add0 of volume dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f608b-2977-4ae0-b9cb-1113715bb5c5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:14 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:29:14 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:14 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:14 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 1G Sep 08 19:29:14 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:15 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:15 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:15 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 1G" returned: 0 in 0.390s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9dfd2b-364e-4415-8808-1e90888d45ba -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:15 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:15 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9dfd2b-364e-4415-8808-1e90888d45ba -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:29:15 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:15 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd9dfd2b-364e-4415-8808-1e90888d45ba -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:15 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 is being set with open permissions: ugo+rw Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:15 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:29:15 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:15 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.251s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:15 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info Sep 08 19:29:15 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:16 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:16 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info is being set with open permissions: ugo+rw Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:16 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info Sep 08 19:29:16 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (874fe362-c65f-4c1c-84f0-9f6016b9ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadf07bb-d4d5-4153-ab7f-ad3a5b61df53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fadf07bb-d4d5-4153-ab7f-ad3a5b61df53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-593008338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85eb6db-70b1-4d60-b431-a8e14cb6d83f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:16Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:16 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a0bb81-a650-43ca-b531-bba75e146a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34a0bb81-a650-43ca-b531-bba75e146a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786bfe7a-a51c-44e1-8bed-2d8394e832d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (786bfe7a-a51c-44e1-8bed-2d8394e832d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b85eb6db-70b1-4d60-b431-a8e14cb6d83f', 'volume_name': 'volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b36d55-625c-4099-9520-4a874bdcd8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b36d55-625c-4099-9520-4a874bdcd8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc88764f-abc3-4f70-8aa1-eb61f73f67cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Volume b85eb6db-70b1-4d60-b431-a8e14cb6d83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f', 'volume_size': 1} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.info" returned: 0 in 0.290s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-593008338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b85eb6db-70b1-4d60-b431-a8e14cb6d83f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:16Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Creating volume b85eb6db-70b1-4d60-b431-a8e14cb6d83f {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:16 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:16 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f 1073741824 Sep 08 19:29:16 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2d795169-9aef-445f-8012-ba9cb091a739 tempest-TestStampPattern-1323443948 None] Create snapshot completed successfully Sep 08 19:29:16 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f 1073741824" returned: 0 in 0.428s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:16 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f Sep 08 19:29:16 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:17 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" returned: 0 in 0.251s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc88764f-abc3-4f70-8aa1-eb61f73f67cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfa762c-f80e-4714-9219-af9298bfb3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Volume volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f (b85eb6db-70b1-4d60-b431-a8e14cb6d83f): created successfully Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cfa762c-f80e-4714-9219-af9298bfb3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (874fe362-c65f-4c1c-84f0-9f6016b9ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1ac2ee65-e185-4349-a1d6-ffeed2e9d791 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (cb24b838-66a0-430a-9972-9792211d0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cb2e1c-8e0d-4b67-8d20-844ab4059511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cb2e1c-8e0d-4b67-8d20-844ab4059511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-637913561',display_name='tempest-VolumesGetTest-Volume-782733476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb88c8c-42d4-4fa4-980e-db78c855fad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:18Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75b82a-849d-41ce-a130-0bbb2f155a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd75b82a-849d-41ce-a130-0bbb2f155a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3759f8c-46fc-4b51-98b7-2d1ea73d9305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3759f8c-46fc-4b51-98b7-2d1ea73d9305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb88c8c-42d4-4fa4-980e-db78c855fad0', 'volume_name': 'volume-edb88c8c-42d4-4fa4-980e-db78c855fad0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53709b41-7f9d-455d-9197-9ff8444018c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53709b41-7f9d-455d-9197-9ff8444018c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f1a093-1dc4-4e52-bf48-fdf0452ba447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:18 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Volume edb88c8c-42d4-4fa4-980e-db78c855fad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb88c8c-42d4-4fa4-980e-db78c855fad0', 'volume_size': 1} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-637913561',display_name='tempest-VolumesGetTest-Volume-782733476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb88c8c-42d4-4fa4-980e-db78c855fad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:18Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Creating volume edb88c8c-42d4-4fa4-980e-db78c855fad0 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:18 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:18 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 1073741824 Sep 08 19:29:18 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:18 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 1073741824" returned: 0 in 0.516s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:18 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 Sep 08 19:29:18 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:19 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0f1a093-1dc4-4e52-bf48-fdf0452ba447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb88c8c-42d4-4fa4-980e-db78c855fad0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1b7cba-e643-4b3e-8302-eba8f731e873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:19 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Volume volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 (edb88c8c-42d4-4fa4-980e-db78c855fad0): created successfully Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1b7cba-e643-4b3e-8302-eba8f731e873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (cb24b838-66a0-430a-9972-9792211d0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-128ea733-d105-4efb-97d7-fde325a67715 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-edb88c8c-42d4-4fa4-980e-db78c855fad0-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "cinder-edb88c8c-42d4-4fa4-980e-db78c855fad0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-edb88c8c-42d4-4fa4-980e-db78c855fad0" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-edb88c8c-42d4-4fa4-980e-db78c855fad0" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac5ec76-6c8f-46f2-a125-964d65413b8d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:20 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 Sep 08 19:29:20 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:20 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0" returned: 0 in 0.382s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:20 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0 Sep 08 19:29:20 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:21 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-edb88c8c-42d4-4fa4-980e-db78c855fad0" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-edb88c8c-42d4-4fa4-980e-db78c855fad0" released by "delete_volume" :: held 0.678s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=61,cinder:UPDATE=67,cinder:INSERT=21,cinder:DELETE=9 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=72,cinder:UPDATE=85,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Created reservations ['3bd55823-f38d-43f4-9542-fe8dfafba643', '32ed9dcf-4c2e-4d2c-b20a-5fc2064606c5', 'e1dbeacf-3dad-424b-bef9-d5ca0297b59a', 'fc0cecac-c7c6-4c0d-88f8-10db654107b2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:21 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:21 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:21 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.291s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-392d6538-6589-4254-9b67-69c4e1761225 tempest-VolumesGetTest-22204296 None] Lock "cinder-edb88c8c-42d4-4fa4-980e-db78c855fad0-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-b85eb6db-70b1-4d60-b431-a8e14cb6d83f-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "cinder-b85eb6db-70b1-4d60-b431-a8e14cb6d83f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de22eaf-a9b2-41f4-9eb0-5f7c8f956094]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:21 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f Sep 08 19:29:21 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:22 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:22 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f Sep 08 19:29:22 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:22 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-b85eb6db-70b1-4d60-b431-a8e14cb6d83f" released by "delete_volume" :: held 0.678s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Created reservations ['e4721b35-a924-49dc-8b8f-4291e903daf1', '460de34b-1e12-4cea-94ff-2fd5f860b494', '097c4463-858e-4381-8e32-66d08258bd79', '7a7008d7-286f-40fa-9708-49ad01b51fe8'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:22 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:22 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:22 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-90d79051-f768-455b-9ab7-fc9b0634817a tempest-VolumesGetTest-22204296 None] Lock "cinder-b85eb6db-70b1-4d60-b431-a8e14cb6d83f-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (b6c0c30b-25e6-45c7-ad2a-3ca571586fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1493b8b1-f032-47ee-a0da-95b1e0873cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Flow 'volume_create_manager' (f1a958f8-b95e-4622-9cbd-b8a5dd978970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66a9b94-fdea-443f-be6e-0e631a5b92a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d66a9b94-fdea-443f-be6e-0e631a5b92a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1123085853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9f8c2c-9732-4469-a56c-36a42feaefed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c399b052f734aca9f0c10d14767efe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1f8ecc7-e3f2-464c-9014-1eaedce9add0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:24Z,use_quota=True,user_id='3fccc232372743c3b1046d7041c5c1c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6d9ba3-1474-4b67-a9b9-0ff8f9708fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6d9ba3-1474-4b67-a9b9-0ff8f9708fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683e6581-4609-4ddc-84ff-b7291dd93094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683e6581-4609-4ddc-84ff-b7291dd93094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e9f8c2c-9732-4469-a56c-36a42feaefed', 'volume_name': 'volume-4e9f8c2c-9732-4469-a56c-36a42feaefed', 'volume_size': 1, 'snapshot_id': 'd1f8ecc7-e3f2-464c-9014-1eaedce9add0'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d50229c-cba5-441b-8f11-e496df826d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d50229c-cba5-441b-8f11-e496df826d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3a460c-b593-454f-94bd-c7b9991ffc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Volume 4e9f8c2c-9732-4469-a56c-36a42feaefed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e9f8c2c-9732-4469-a56c-36a42feaefed', 'volume_size': 1, 'snapshot_id': 'd1f8ecc7-e3f2-464c-9014-1eaedce9add0'} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1493b8b1-f032-47ee-a0da-95b1e0873cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-206187191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fb1039-fd72-46a5-ba63-d1ff11035526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:24Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32949d30-e224-4cd3-82d4-75f6fb3ff469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32949d30-e224-4cd3-82d4-75f6fb3ff469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc1ba06-ea36-4ce6-80de-56a092df99d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc1ba06-ea36-4ce6-80de-56a092df99d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04fb1039-fd72-46a5-ba63-d1ff11035526', 'volume_name': 'volume-04fb1039-fd72-46a5-ba63-d1ff11035526', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d64c75d-c2cb-48cb-a085-999d172be83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d64c75d-c2cb-48cb-a085-999d172be83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576b7a59-1815-4e59-96a7-4162dbc5e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Volume 04fb1039-fd72-46a5-ba63-d1ff11035526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04fb1039-fd72-46a5-ba63-d1ff11035526', 'volume_size': 1} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-206187191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04fb1039-fd72-46a5-ba63-d1ff11035526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:24Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Creating volume 04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:23 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:23 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 1073741824 Sep 08 19:29:23 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:24 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 1073741824" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:24 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:24 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:24 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.279s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.802s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-4e9f8c2c-9732-4469-a56c-36a42feaefed" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576b7a59-1815-4e59-96a7-4162dbc5e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04fb1039-fd72-46a5-ba63-d1ff11035526', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8309e3-4184-4cd8-a59b-e3aa50f58e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-4e9f8c2c-9732-4469-a56c-36a42feaefed" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Creating volume 4e9f8c2c-9732-4469-a56c-36a42feaefed from snapshot d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Volume volume-04fb1039-fd72-46a5-ba63-d1ff11035526 (04fb1039-fd72-46a5-ba63-d1ff11035526): created successfully Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8309e3-4184-4cd8-a59b-e3aa50f58e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (b6c0c30b-25e6-45c7-ad2a-3ca571586fed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] snapshot: d1f8ecc7-e3f2-464c-9014-1eaedce9add0, volume: 4e9f8c2c-9732-4469-a56c-36a42feaefed, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:29:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cb540b7e-4849-4e97-9bda-9904169a8cc1 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b3793b-efbb-478b-b463-d69d7f98dcd6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:24 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:29:24 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:25 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.414s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd9dfd2b-364e-4415-8808-1e90888d45ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2b2641-efc0-418e-87ca-ae28e613d661]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:25 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:29:25 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:25 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.551s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:29:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:25 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed Sep 08 19:29:25 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (98051c24-e4ea-4efa-8568-c0c34cf3993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47bae38-9fdc-41f6-ac3b-3a9665a2897d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47bae38-9fdc-41f6-ac3b-3a9665a2897d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-525447045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0901e80e-858b-4029-9bcd-f811825f95ce,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=04fb1039-fd72-46a5-ba63-d1ff11035526,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:26Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70256db1-eeb7-4141-aa4c-c81841a2586b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70256db1-eeb7-4141-aa4c-c81841a2586b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f9769f-6633-46e1-80d5-7c680165c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f9769f-6633-46e1-80d5-7c680165c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0901e80e-858b-4029-9bcd-f811825f95ce', 'volume_name': 'volume-0901e80e-858b-4029-9bcd-f811825f95ce', 'volume_size': 1, 'source_volid': '04fb1039-fd72-46a5-ba63-d1ff11035526', 'source_volstatus': 'available'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9a70e5-b0b4-4eea-bbec-09d245603244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d9a70e5-b0b4-4eea-bbec-09d245603244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6307abc0-221a-4250-a465-35234e6205c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:26 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Volume 0901e80e-858b-4029-9bcd-f811825f95ce: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0901e80e-858b-4029-9bcd-f811825f95ce', 'volume_size': 1, 'source_volid': '04fb1039-fd72-46a5-ba63-d1ff11035526', 'source_volstatus': 'available'} Sep 08 19:29:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:31 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed" returned: 0 in 5.881s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:31 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:29:31 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Converted 1024.00 MB image at 174.08 MB/s Sep 08 19:29:31 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed is being set with open permissions: ugo+rw Sep 08 19:29:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:31 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed Sep 08 19:29:31 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:32 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed" returned: 0 in 0.317s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" released by "_copy_volume_from_snapshot" :: held 7.280s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-4e9f8c2c-9732-4469-a56c-36a42feaefed" released by "_create_volume_from_snapshot" :: held 7.380s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.418s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.580s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:32 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Cloning volume 04fb1039-fd72-46a5-ba63-d1ff11035526 to volume 0901e80e-858b-4029-9bcd-f811825f95ce Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3a460c-b593-454f-94bd-c7b9991ffc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9f8c2c-9732-4469-a56c-36a42feaefed', 'volume_size': 1, 'snapshot_id': 'd1f8ecc7-e3f2-464c-9014-1eaedce9add0'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029b7a75-7e4c-4c36-be7c-a7e57694102f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Volume volume-4e9f8c2c-9732-4469-a56c-36a42feaefed (4e9f8c2c-9732-4469-a56c-36a42feaefed): created successfully Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029b7a75-7e4c-4c36-be7c-a7e57694102f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Flow 'volume_create_manager' (f1a958f8-b95e-4622-9cbd-b8a5dd978970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Creating offline snapshot 5f9b4313-5691-40cb-a639-3378b91bc833 of volume 04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8035b35f-b11c-4de0-afe5-60e12e4a99ca]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:32 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-35718167-a152-4287-a02b-da748500bf70 tempest-TestStampPattern-1323443948 None] Created volume successfully. Sep 08 19:29:32 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:32 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:32 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.453s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:32 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 1G Sep 08 19:29:32 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:33 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 1G" returned: 0 in 0.502s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fb1039-fd72-46a5-ba63-d1ff11035526 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:33 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fb1039-fd72-46a5-ba63-d1ff11035526 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:33 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:33 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04fb1039-fd72-46a5-ba63-d1ff11035526 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:33 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 is being set with open permissions: ugo+rw Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:33 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:33 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:33 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.272s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:33 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info Sep 08 19:29:33 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:34 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:34 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info is being set with open permissions: ugo+rw Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:34 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info Sep 08 19:29:34 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:34 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.info" returned: 0 in 0.269s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] snapshot: 5f9b4313-5691-40cb-a639-3378b91bc833, volume: 0901e80e-858b-4029-9bcd-f811825f95ce, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fedca7e-b2f6-45ab-b4c4-bf169bbd3603]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:34 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:34 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:34 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.444s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fb1039-fd72-46a5-ba63-d1ff11035526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e56ee7e-99e6-4c8d-a528-720cbdf22a07]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:35 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:35 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:35 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.455s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:29:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:29:35 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:29:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:35 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce Sep 08 19:29:35 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:41 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce" returned: 0 in 6.074s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:29:41 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Converted 1024.00 MB image at 168.55 MB/s Sep 08 19:29:41 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce is being set with open permissions: ugo+rw Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:41 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce Sep 08 19:29:41 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:41 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" released by "_copy_volume_from_snapshot" :: held 7.357s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-5f9b4313-5691-40cb-a639-3378b91bc833" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-5f9b4313-5691-40cb-a639-3378b91bc833" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Deleting offline snapshot 5f9b4313-5691-40cb-a639-3378b91bc833 of volume 04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] snapshot_file for this snap is: volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11fd3ea-e9ec-49d2-a7df-8de62772052e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:41 devstack sudo[103175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:41 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:42 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.400s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04fb1039-fd72-46a5-ba63-d1ff11035526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed0eea-0f2c-4696-9cd5-074dec975cb6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:42 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:42 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:42 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.510s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:42 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:42 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:43 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:43 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833 Sep 08 19:29:43 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:43 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526.5f9b4313-5691-40cb-a639-3378b91bc833" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-5f9b4313-5691-40cb-a639-3378b91bc833" released by "_delete_snapshot" :: held 1.609s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.358s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6307abc0-221a-4250-a465-35234e6205c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0901e80e-858b-4029-9bcd-f811825f95ce', 'volume_size': 1, 'source_volid': '04fb1039-fd72-46a5-ba63-d1ff11035526', 'source_volstatus': 'available'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acf5d16-c108-4f7f-b76d-92e797c2445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Volume volume-0901e80e-858b-4029-9bcd-f811825f95ce (0901e80e-858b-4029-9bcd-f811825f95ce): created successfully Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acf5d16-c108-4f7f-b76d-92e797c2445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (98051c24-e4ea-4efa-8568-c0c34cf3993a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f6b8fffa-469e-49dd-905c-5979cec14cc1 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (14799a91-b10b-4bdd-b839-ba7e3a164771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203a7797-f6c2-474c-9c63-d4bde14ab689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203a7797-f6c2-474c-9c63-d4bde14ab689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-216128526',display_name='tempest-VolumesGetTest-Volume-206242084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dad1b1-ac97-4b9c-bacf-f02bc49b38e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:45Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47d6466-1f08-4d34-8969-d6f512800fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47d6466-1f08-4d34-8969-d6f512800fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a4d15b-f304-4671-9228-65e9e1f6d4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a4d15b-f304-4671-9228-65e9e1f6d4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75dad1b1-ac97-4b9c-bacf-f02bc49b38e3', 'volume_name': 'volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74416215-2e5f-4fa8-92b6-2f5e8c9773a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74416215-2e5f-4fa8-92b6-2f5e8c9773a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3f4e48-9ee9-49ee-bc87-0e281282e566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Volume 75dad1b1-ac97-4b9c-bacf-f02bc49b38e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3', 'volume_size': 1} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-216128526',display_name='tempest-VolumesGetTest-Volume-206242084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75dad1b1-ac97-4b9c-bacf-f02bc49b38e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:45Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Creating volume 75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:45 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:45 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 1073741824 Sep 08 19:29:45 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:45 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 1073741824" returned: 0 in 0.427s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:45 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 Sep 08 19:29:45 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:45 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3f4e48-9ee9-49ee-bc87-0e281282e566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9ddbfe-50df-4dcd-afc6-2cd290517ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Volume volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 (75dad1b1-ac97-4b9c-bacf-f02bc49b38e3): created successfully Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe9ddbfe-50df-4dcd-afc6-2cd290517ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (14799a91-b10b-4bdd-b839-ba7e3a164771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d42d675d-979e-4be2-a077-73bc8977dfc5 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "cinder-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[20facc2b-f3c0-4529-9f08-25b59a960a9c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:46 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 Sep 08 19:29:46 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:46 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:46 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3 Sep 08 19:29:46 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:46 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3" released by "delete_volume" :: held 0.643s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Created reservations ['6d617f42-3ce0-4b21-bcc5-16c80161f60a', '7f1ae902-bf87-4ed6-a8e3-c41e84951a6b', 'de3a49ef-5c69-459f-b96b-aaa089fe1f33', 'b9afe6a2-d55e-409d-9f7f-9399e6f20b03'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:47 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:47 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:47 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-99937750-ca6b-4c30-b665-1a2a0f37facb tempest-VolumesGetTest-22204296 None] Lock "cinder-75dad1b1-ac97-4b9c-bacf-f02bc49b38e3-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-0901e80e-858b-4029-9bcd-f811825f95ce-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "cinder-0901e80e-858b-4029-9bcd-f811825f95ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[13807450-3e3b-4f79-91eb-d543f01312da]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:47 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce Sep 08 19:29:47 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:47 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:47 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce Sep 08 19:29:47 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:48 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0901e80e-858b-4029-9bcd-f811825f95ce" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-0901e80e-858b-4029-9bcd-f811825f95ce" released by "delete_volume" :: held 0.645s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Created reservations ['b8850f54-f16f-4189-a1cf-5142c5d6ac8a', 'fd7ca918-0f88-4e76-afed-8aef9d9acc6d', '4426c90a-96bb-43ce-9a9a-c32ec0d91acd', 'f4c9452d-bf36-4875-9da7-9e3aa29f0fe6'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:48 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:48 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:48 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c36f5f5f-41e8-4c93-9f0b-c9fcdd262f53 tempest-VolumesGetTest-22204296 None] Lock "cinder-0901e80e-858b-4029-9bcd-f811825f95ce-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-04fb1039-fd72-46a5-ba63-d1ff11035526-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "cinder-04fb1039-fd72-46a5-ba63-d1ff11035526-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-04fb1039-fd72-46a5-ba63-d1ff11035526" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-04fb1039-fd72-46a5-ba63-d1ff11035526" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c744d-01b6-4217-a97f-608f5acfd678]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:48 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:48 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:49 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:49 devstack sudo[103243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526 Sep 08 19:29:49 devstack sudo[103243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:49 devstack sudo[103243]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-04fb1039-fd72-46a5-ba63-d1ff11035526" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-04fb1039-fd72-46a5-ba63-d1ff11035526" released by "delete_volume" :: held 0.649s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Created reservations ['5a43bc0f-616e-480d-83ca-3f2c41b85deb', '499ac9f9-2950-42e0-9130-afb74e12efc8', 'c9bf9387-6f50-4813-9519-033aaec21896', 'b6224222-d38d-4334-988d-ddb8ca61f0d0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:49 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:49 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:49 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-26465a0a-3993-445d-9b6d-56f737a6fee4 tempest-VolumesGetTest-22204296 None] Lock "cinder-04fb1039-fd72-46a5-ba63-d1ff11035526-delete_volume" released by "delete_volume" :: held 1.116s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (d8848cd2-76d7-4618-8264-34fec7d72ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d706f1ce-8aab-48fd-891c-7a53d0df81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d706f1ce-8aab-48fd-891c-7a53d0df81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2096930369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e932f7a-142d-45a4-ad1c-727d1bc55ccc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:50Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cccd9be-88f7-4b38-8cf6-3e1bdc6817c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cccd9be-88f7-4b38-8cf6-3e1bdc6817c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fa5748-80fa-4d67-80ba-8335add452d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04fa5748-80fa-4d67-80ba-8335add452d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e932f7a-142d-45a4-ad1c-727d1bc55ccc', 'volume_name': 'volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb4261-cb52-415e-911e-1f0dd6004e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb4261-cb52-415e-911e-1f0dd6004e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9709cc9f-0e4f-44d5-93fe-720755be22ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:29:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Trying to clone 9e932f7a-142d-45a4-ad1c-727d1bc55ccc from image 6b778823-fa2d-480a-aa07-bfb706774474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:29:51 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[652aba7d-644f-476c-af58-ade5348fcebe]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:51 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD Sep 08 19:29:51 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:51 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 is fetched for user f40b5214bd644426bdb1701980955b66. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeec7ec-07f6-4e27-80c4-865e3eb3299a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:51 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD Sep 08 19:29:51 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:51 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2096930369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e932f7a-142d-45a4-ad1c-727d1bc55ccc,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:50Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Creating volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:51 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1073741824 Sep 08 19:29:51 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:52 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1073741824" returned: 0 in 0.415s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:52 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc Sep 08 19:29:52 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:52 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Attempting download of 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d089a2fc-b404-490b-be9e-3ad84bb8f40b]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:52 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj Sep 08 19:29:52 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:52 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj" returned: 0 in 0.313s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:53 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj Sep 08 19:29:53 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:53 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj" returned: 1 in 0.320s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_uiiuszhj' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6efdd7a-4c74-4337-b02b-9b1ebb0222df]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:53 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD Sep 08 19:29:53 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:53 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] 6b778823-fa2d-480a-aa07-bfb706774474 was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:29:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:53 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc Sep 08 19:29:53 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:55 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" returned: 0 in 1.554s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_g8vhlp0tdevstack@QuobyteHD, size 112.00 MB, duration 1.56 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:29:55 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Converted 112.00 MB image at 72.00 MB/s Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:55 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1G Sep 08 19:29:55 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:55 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc 1G" returned: 0 in 0.304s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Downloaded image 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 for user f40b5214bd644426bdb1701980955b66 is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Marking volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Copying metadata from image 6b778823-fa2d-480a-aa07-bfb706774474 to 9e932f7a-142d-45a4-ad1c-727d1bc55ccc. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Creating volume glance metadata for volume 9e932f7a-142d-45a4-ad1c-727d1bc55ccc backed by image 6b778823-fa2d-480a-aa07-bfb706774474 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9709cc9f-0e4f-44d5-93fe-720755be22ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf9ae56-7d6c-43e8-80f6-19f82eb379c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Volume volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc (9e932f7a-142d-45a4-ad1c-727d1bc55ccc): created successfully Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf9ae56-7d6c-43e8-80f6-19f82eb379c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (d8848cd2-76d7-4618-8264-34fec7d72ca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5ebb534b-9e39-44b6-baab-b59196209188 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (1761927c-34c2-4c38-8f6e-2e49ad657e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b0569-b47e-4ac8-b4e5-8cead837cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a84b0569-b47e-4ac8-b4e5-8cead837cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-438796578',display_name='tempest-VolumesGetTest-Volume-1081902035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387b16da-1744-42ee-9a43-e5d342cb4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:57Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2971f6-6d63-4bba-87d6-34de029d4dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2971f6-6d63-4bba-87d6-34de029d4dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8a7a63-fa53-4959-b35d-bfd9c44acd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8a7a63-fa53-4959-b35d-bfd9c44acd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '387b16da-1744-42ee-9a43-e5d342cb4596', 'volume_name': 'volume-387b16da-1744-42ee-9a43-e5d342cb4596', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7587447b-be5b-4db9-a335-7b48a73f35d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7587447b-be5b-4db9-a335-7b48a73f35d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be109dc-63c2-43f7-ab7a-212ab19e7ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Volume 387b16da-1744-42ee-9a43-e5d342cb4596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-387b16da-1744-42ee-9a43-e5d342cb4596', 'volume_size': 1} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:29:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-438796578',display_name='tempest-VolumesGetTest-Volume-1081902035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=387b16da-1744-42ee-9a43-e5d342cb4596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d68c2ce4b64e2183873f4d9c5934fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:29:57Z,use_quota=True,user_id='f40b5214bd644426bdb1701980955b66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Creating volume 387b16da-1744-42ee-9a43-e5d342cb4596 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:29:57 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:57 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 1073741824 Sep 08 19:29:57 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:57 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 1073741824" returned: 0 in 0.400s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:57 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 Sep 08 19:29:57 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:58 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1be109dc-63c2-43f7-ab7a-212ab19e7ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-387b16da-1744-42ee-9a43-e5d342cb4596', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72143850-2d2d-4b92-8e27-7c2652b7b38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:29:58 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Volume volume-387b16da-1744-42ee-9a43-e5d342cb4596 (387b16da-1744-42ee-9a43-e5d342cb4596): created successfully Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72143850-2d2d-4b92-8e27-7c2652b7b38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Flow 'volume_create_manager' (1761927c-34c2-4c38-8f6e-2e49ad657e09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:29:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4323c19d-564c-4f27-b0f7-33dd02c82a41 tempest-VolumesGetTest-22204296 None] Created volume successfully. Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-387b16da-1744-42ee-9a43-e5d342cb4596-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "cinder-387b16da-1744-42ee-9a43-e5d342cb4596-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-387b16da-1744-42ee-9a43-e5d342cb4596" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-387b16da-1744-42ee-9a43-e5d342cb4596" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dada0e-4035-44ed-9aa1-fa63438fa206]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:58 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 Sep 08 19:29:58 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:58 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596" returned: 0 in 0.359s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:58 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596 Sep 08 19:29:58 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:59 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-387b16da-1744-42ee-9a43-e5d342cb4596" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-387b16da-1744-42ee-9a43-e5d342cb4596" released by "delete_volume" :: held 0.647s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Created reservations ['aa067e3c-4900-40e8-8f5b-fced2e252867', '414637a0-416d-4b63-be95-a9d4d89c9337', '4f36bd40-aabc-41d2-bd41-bdebe39cb716', 'e07e3294-82d5-4fca-8463-4f2139761629'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:59 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:29:59 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:29:59 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.267s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:29:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bc2da4f3-8c8b-4aa1-abfd-6370ad64ba53 tempest-VolumesGetTest-22204296 None] Lock "cinder-387b16da-1744-42ee-9a43-e5d342cb4596-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-9e932f7a-142d-45a4-ad1c-727d1bc55ccc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "cinder-9e932f7a-142d-45a4-ad1c-727d1bc55ccc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Acquiring lock "cinder-quobyte-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d4513f-410c-4659-9ac7-490de5ae8aef]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:29:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:29:59 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc Sep 08 19:29:59 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:00 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" returned: 0 in 0.362s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:00 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc Sep 08 19:30:00 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:00 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "cinder-quobyte-9e932f7a-142d-45a4-ad1c-727d1bc55ccc" released by "delete_volume" :: held 0.655s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Created reservations ['28791830-1cde-4e2f-b48a-e8e758024f2d', 'fcf6af24-a923-4165-9724-d7519acbe239', 'c6342383-91ac-417e-a14c-d824afe3b3ed', '559790d7-e9e2-48cd-bbff-422e521b017b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:00 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:30:00 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:00 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.256s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:30:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Deleted volume successfully. Sep 08 19:30:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a4abca36-e96b-4770-b294-11ac853291c2 tempest-VolumesGetTest-22204296 None] Lock "cinder-9e932f7a-142d-45a4-ad1c-727d1bc55ccc-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Flow 'volume_create_manager' (b88bd0ab-eb9d-428d-8186-23c14fbdb3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e677a46-63aa-4f09-8df2-ad2374674ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e677a46-63aa-4f09-8df2-ad2374674ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-27956200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f502bfe-757a-4e0d-868e-64d79c781ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26aab4d831343579589b77d9326e017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:04Z,use_quota=True,user_id='54d0a740828f41a39a7fd0bfc7496591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d340d7-802d-448a-b4d5-716e56b156d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60d340d7-802d-448a-b4d5-716e56b156d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a5fcc-a201-48cc-b2ae-a0eb6c9ac3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac8a5fcc-a201-48cc-b2ae-a0eb6c9ac3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f502bfe-757a-4e0d-868e-64d79c781ef2', 'volume_name': 'volume-0f502bfe-757a-4e0d-868e-64d79c781ef2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f314cbd8-b3f6-4104-ab00-e60b5adf57b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f314cbd8-b3f6-4104-ab00-e60b5adf57b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d0e3a6-8230-4230-9966-464345113bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:04 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Volume 0f502bfe-757a-4e0d-868e-64d79c781ef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f502bfe-757a-4e0d-868e-64d79c781ef2', 'volume_size': 1} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-27956200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f502bfe-757a-4e0d-868e-64d79c781ef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c26aab4d831343579589b77d9326e017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:04Z,use_quota=True,user_id='54d0a740828f41a39a7fd0bfc7496591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Creating volume 0f502bfe-757a-4e0d-868e-64d79c781ef2 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:04 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:04 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 1073741824 Sep 08 19:30:04 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:04 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 1073741824" returned: 0 in 0.396s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:04 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 Sep 08 19:30:04 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:05 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54d0e3a6-8230-4230-9966-464345113bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f502bfe-757a-4e0d-868e-64d79c781ef2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cf3558-7310-4126-9f2d-9b3513d9921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:05 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Volume volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 (0f502bfe-757a-4e0d-868e-64d79c781ef2): created successfully Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67cf3558-7310-4126-9f2d-9b3513d9921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Flow 'volume_create_manager' (b88bd0ab-eb9d-428d-8186-23c14fbdb3e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-08bca3f6-486c-4406-8912-d9d42468bd2d tempest-VolumesNegativeTest-1084309591 None] Created volume successfully. Sep 08 19:30:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:30:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:30:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=62,cinder:INSERT=30,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:INSERT=20,cinder:UPDATE=79,cinder:SELECT=57,cinder:DELETE=7 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-59cc05aa-16c8-4780-9390-841d92e38c7d req-ed025228-262e-44c4-b096-de4412a2188a tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-59cc05aa-16c8-4780-9390-841d92e38c7d req-ed025228-262e-44c4-b096-de4412a2188a tempest-TestStampPattern-1323443948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-59cc05aa-16c8-4780-9390-841d92e38c7d req-ed025228-262e-44c4-b096-de4412a2188a tempest-TestStampPattern-1323443948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-59cc05aa-16c8-4780-9390-841d92e38c7d req-ed025228-262e-44c4-b096-de4412a2188a tempest-TestStampPattern-1323443948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-4e9f8c2c-9732-4469-a56c-36a42feaefed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbea7b72-05b5-42da-85f4-631ab55fdd90', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:30:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-59cc05aa-16c8-4780-9390-841d92e38c7d req-ed025228-262e-44c4-b096-de4412a2188a tempest-TestStampPattern-1323443948 None] attachment_update completed successfully. Sep 08 19:30:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-3ef9fed2-15a8-483a-9116-7942254d82e9 req-a180eb0d-5b00-4ff3-8373-dd85a5ad3673 tempest-TestStampPattern-1323443948 None] Terminate volume connection completed successfully. Sep 08 19:30:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-3ef9fed2-15a8-483a-9116-7942254d82e9 req-a180eb0d-5b00-4ff3-8373-dd85a5ad3673 tempest-TestStampPattern-1323443948 None] Deleting attachment bbea7b72-05b5-42da-85f4-631ab55fdd90. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Acquiring lock "cinder-0f502bfe-757a-4e0d-868e-64d79c781ef2-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "cinder-0f502bfe-757a-4e0d-868e-64d79c781ef2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Acquiring lock "cinder-quobyte-0f502bfe-757a-4e0d-868e-64d79c781ef2" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "cinder-quobyte-0f502bfe-757a-4e0d-868e-64d79c781ef2" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957c662-0213-4f47-95b9-3631be2b3841]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:21 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 Sep 08 19:30:21 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:21 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2" returned: 0 in 0.417s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:22 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2 Sep 08 19:30:22 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:22 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0f502bfe-757a-4e0d-868e-64d79c781ef2" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "cinder-quobyte-0f502bfe-757a-4e0d-868e-64d79c781ef2" released by "delete_volume" :: held 0.757s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Created reservations ['711997f4-e311-42cd-9ad0-5eee88b407f0', '96636e14-2cb8-4551-9709-49d840c3b4f5', 'dafccbfc-3d42-4aea-a4be-8923232c77d9', 'e3354f91-141f-4688-abf7-53aa2cd2a103'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:22 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:30:22 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:22 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:30:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Deleted volume successfully. Sep 08 19:30:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2b23bfe8-fa6e-4922-a17d-edce59f6388f tempest-VolumesNegativeTest-1084309591 None] Lock "cinder-0f502bfe-757a-4e0d-868e-64d79c781ef2-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-4e9f8c2c-9732-4469-a56c-36a42feaefed-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "cinder-4e9f8c2c-9732-4469-a56c-36a42feaefed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2dc6e3-f1c5-4a7e-bcde-bf2845e5b6fa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:24 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed Sep 08 19:30:24 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:24 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:24 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed Sep 08 19:30:24 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:24 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4e9f8c2c-9732-4469-a56c-36a42feaefed" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-4e9f8c2c-9732-4469-a56c-36a42feaefed" released by "delete_volume" :: held 0.657s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Created reservations ['155f365c-8d2e-4515-82f1-46da5912508b', '9d7ea642-ae98-4fe7-8e7f-d9b113b3f0c4', '50ab35a3-8f43-46aa-887a-4d58ec5d8578', 'f7c6ff5d-d936-4468-81cf-12434e8edb87'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:24 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:30:24 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:25 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.288s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:30:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Deleted volume successfully. Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c54b24a9-1d7c-4c73-ad1d-6f2c5c7109b5 tempest-TestStampPattern-1323443948 None] Lock "cinder-4e9f8c2c-9732-4469-a56c-36a42feaefed-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Deleting offline snapshot d1f8ecc7-e3f2-464c-9014-1eaedce9add0 of volume dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] snapshot_file for this snap is: volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043dcc0-6262-4806-9909-b732ecbdd99a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:25 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:30:25 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:26 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd9dfd2b-364e-4415-8808-1e90888d45ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f71ef4-c930-448a-a044-17cde60dcccd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:26 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:30:26 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:26 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.552s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:26 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:30:26 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:27 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.342s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:27 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0 Sep 08 19:30:27 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:27 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba.d1f8ecc7-e3f2-464c-9014-1eaedce9add0" returned: 0 in 0.271s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-d1f8ecc7-e3f2-464c-9014-1eaedce9add0" released by "_delete_snapshot" :: held 1.680s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" released by "delete_snapshot" :: held 1.716s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Created reservations ['1a0bd6fd-82f0-440c-9e1c-eac0f77cc78b', '19bf6ac1-4f80-4ac5-91f5-35d6733ae283', '1ecd2eb0-49b1-4973-b1da-80e23854336d', 'd7d41562-3449-4b8e-9c6b-5f2d21932dc6'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Delete snapshot completed successfully. Sep 08 19:30:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f445585d-b5d2-456c-b7d3-f1469bc1ed7a tempest-TestStampPattern-1323443948 None] Lock "cinder-d1f8ecc7-e3f2-464c-9014-1eaedce9add0-delete_snapshot" released by "delete_snapshot" :: held 1.856s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-dd9dfd2b-364e-4415-8808-1e90888d45ba-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "cinder-dd9dfd2b-364e-4415-8808-1e90888d45ba-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Acquiring lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[558bbfa7-605f-40d0-bc4d-08d8430a8561]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:32 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:30:32 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:32 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.397s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:32 devstack sudo[104024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba Sep 08 19:30:32 devstack sudo[104024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:33 devstack sudo[104024]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dd9dfd2b-364e-4415-8808-1e90888d45ba" returned: 0 in 0.271s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "cinder-quobyte-dd9dfd2b-364e-4415-8808-1e90888d45ba" released by "delete_volume" :: held 0.730s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Created reservations ['4542f89f-de97-4195-8b33-ed14a588ff83', '44df8eb7-25de-4892-baae-2ed1276e0855', 'a9f968b6-fb2c-4aa8-ae64-de4a9f7c27af', 'b4bd9a5b-c9d2-4d8c-a0ba-6aac3cf24cf4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:33 devstack sudo[104027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:30:33 devstack sudo[104027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:33 devstack sudo[104027]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.282s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:30:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Deleted volume successfully. Sep 08 19:30:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7e13b720-4f37-4b69-8c2e-8ec7dcdbc97d tempest-TestStampPattern-1323443948 None] Lock "cinder-dd9dfd2b-364e-4415-8808-1e90888d45ba-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (7e08ae8f-3acc-49c6-a499-ced693a3bff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bef877-262b-4fcf-9834-ffdbb9fe8e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bef877-262b-4fcf-9834-ffdbb9fe8e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897001301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3efe2-c5cc-4236-b366-bf50a4ea834a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:35Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f2a0b2-a492-4817-bad3-b7010f1dd448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f2a0b2-a492-4817-bad3-b7010f1dd448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90982e5-a458-44df-82cd-e903a5a587a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a90982e5-a458-44df-82cd-e903a5a587a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03f3efe2-c5cc-4236-b366-bf50a4ea834a', 'volume_name': 'volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c368899-6138-4401-beed-4a49bc94f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c368899-6138-4401-beed-4a49bc94f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36527843-bb15-4b38-bcc6-0234549d8ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Volume 03f3efe2-c5cc-4236-b366-bf50a4ea834a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a', 'volume_size': 1} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1897001301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f3efe2-c5cc-4236-b366-bf50a4ea834a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:35Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Creating volume 03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:35 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:35 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a 1073741824 Sep 08 19:30:35 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:35 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a 1073741824" returned: 0 in 0.465s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:35 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a Sep 08 19:30:35 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:36 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36527843-bb15-4b38-bcc6-0234549d8ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c8b2d2-1010-4ca1-ba38-3ef4d50e3780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:36 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Volume volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a (03f3efe2-c5cc-4236-b366-bf50a4ea834a): created successfully Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c8b2d2-1010-4ca1-ba38-3ef4d50e3780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (7e08ae8f-3acc-49c6-a499-ced693a3bff1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c44d70f0-1b7a-4b12-98e5-9a9b85f539a3 tempest-VolumesSnapshotTestJSON-76797717 None] Created volume successfully. Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Creating offline snapshot d4e06da4-9e55-448b-9b59-25762ffaeca6 of volume 03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[76877bf4-cb82-47f9-b270-7580aada5b24]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:36 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a Sep 08 19:30:36 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:37 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a" returned: 0 in 0.357s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:37 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 1G Sep 08 19:30:37 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:37 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 1G" returned: 0 in 0.421s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:37 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 Sep 08 19:30:37 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:37 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:37 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 is being set with open permissions: ugo+rw Sep 08 19:30:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:37 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 Sep 08 19:30:37 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:38 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:38 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info Sep 08 19:30:38 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:38 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:38 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info is being set with open permissions: ugo+rw Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:38 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info Sep 08 19:30:38 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:38 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.info" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bd3b3c39-48a1-4571-b2f3-b2a9d4251e30 tempest-VolumesSnapshotTestJSON-76797717 None] Create snapshot completed successfully Sep 08 19:30:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-d4e06da4-9e55-448b-9b59-25762ffaeca6-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-d4e06da4-9e55-448b-9b59-25762ffaeca6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-d4e06da4-9e55-448b-9b59-25762ffaeca6" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d4e06da4-9e55-448b-9b59-25762ffaeca6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Deleting offline snapshot d4e06da4-9e55-448b-9b59-25762ffaeca6 of volume 03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] snapshot_file for this snap is: volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[205633cf-4c42-423f-9a1e-866d6205753b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:40 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 Sep 08 19:30:40 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:40 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6" returned: 0 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a675e214-1c11-46bb-bd00-ad8db1e9c157]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:40 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a Sep 08 19:30:40 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:40 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a" returned: 0 in 0.384s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:40 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 Sep 08 19:30:40 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:41 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:41 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6 Sep 08 19:30:41 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:41 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a.d4e06da4-9e55-448b-9b59-25762ffaeca6" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d4e06da4-9e55-448b-9b59-25762ffaeca6" released by "_delete_snapshot" :: held 1.447s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" released by "delete_snapshot" :: held 1.470s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['5d397909-272c-43fd-b87d-c65cd2df4606', '045b41f7-40bd-4c2d-8195-3be7b2c6915f', '0a272685-875a-4d39-b696-d7f40e709129', '51fd0767-3441-4eea-8a05-40e5e29ce496'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Delete snapshot completed successfully. Sep 08 19:30:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-50cdb4c8-15f0-48b8-ac73-b3272018b1d6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-d4e06da4-9e55-448b-9b59-25762ffaeca6-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (8b578150-aadd-4113-9b8e-10275e3c3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a4eb73-c85f-4230-a926-11c17a222c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a4eb73-c85f-4230-a926-11c17a222c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-853708840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:43Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb6461a-c06d-4e94-8c4b-a291b9c2ba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb6461a-c06d-4e94-8c4b-a291b9c2ba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f1798f-c454-4100-8dfa-af150acee467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f1798f-c454-4100-8dfa-af150acee467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd563f479-b0e4-4ebe-a09f-2c9e4bcd3efc', 'volume_name': 'volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5320eef-0465-4b1a-96d8-a64d901d8d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5320eef-0465-4b1a-96d8-a64d901d8d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999319c6-ebd7-495a-a6aa-61136e117020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:42 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Volume d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc', 'volume_size': 1} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-853708840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:43Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Creating volume d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:42 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:30:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:42 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc 1073741824 Sep 08 19:30:42 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:43 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc 1073741824" returned: 0 in 0.451s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:43 devstack sudo[104130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:30:43 devstack sudo[104130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:43 devstack sudo[104130]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.269s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (999319c6-ebd7-495a-a6aa-61136e117020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e4738-8d6b-4240-921e-3ed4a38e312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Volume volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc (d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc): created successfully Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309e4738-8d6b-4240-921e-3ed4a38e312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (8b578150-aadd-4113-9b8e-10275e3c3faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-018cf795-8f7b-48ab-a7ed-d00d7619feb8 tempest-VolumesSnapshotTestJSON-76797717 None] Created volume successfully. Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Creating offline snapshot e48d52c9-d7ca-4074-a9b6-935ad82519f8 of volume d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5a69e6-2e2c-4caa-b459-bbc8a7fe47da]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:44 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:30:44 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:44 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.401s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:44 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 1G Sep 08 19:30:44 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:44 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 1G" returned: 0 in 0.433s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:44 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:30:44 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:45 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 0.333s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:45 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 is being set with open permissions: ugo+rw Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:45 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:30:45 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:45 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:45 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info Sep 08 19:30:45 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:45 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:45 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info is being set with open permissions: ugo+rw Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:45 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info Sep 08 19:30:45 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:45 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.info" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:45 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Flow 'volume_create_manager' (e4c85979-49e3-40d0-81a1-084aa07b05ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a922ff8a-01a7-4831-a05f-a3140fc7730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a922ff8a-01a7-4831-a05f-a3140fc7730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-817470316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8af61e2-7072-4501-8ad6-df7ebc0d5bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cb35e28d0b45bf8f1ee1bd97eca610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:46Z,use_quota=True,user_id='f8e33f520d9a4e0f98010c8c4dfd9590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43b92b3-b2e9-461e-aeba-4fc0058fa965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43b92b3-b2e9-461e-aeba-4fc0058fa965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4966fc21-5a18-4906-bd6b-8a4ca2ddefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4966fc21-5a18-4906-bd6b-8a4ca2ddefe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8af61e2-7072-4501-8ad6-df7ebc0d5bd3', 'volume_name': 'volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea0a63d-4be6-4402-a1b5-1b57512f37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea0a63d-4be6-4402-a1b5-1b57512f37d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd2490c-1237-49db-8e11-912a8c4dc80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Volume f8af61e2-7072-4501-8ad6-df7ebc0d5bd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3', 'volume_size': 1} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-817470316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8af61e2-7072-4501-8ad6-df7ebc0d5bd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cb35e28d0b45bf8f1ee1bd97eca610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:46Z,use_quota=True,user_id='f8e33f520d9a4e0f98010c8c4dfd9590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Creating volume f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:46 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97153172-1ca6-4922-8da3-042f90f3a1ec tempest-VolumesSnapshotTestJSON-76797717 None] Create snapshot completed successfully Sep 08 19:30:46 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 1073741824 Sep 08 19:30:46 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:46 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 1073741824" returned: 0 in 0.405s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:46 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:30:46 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:46 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd2490c-1237-49db-8e11-912a8c4dc80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77ebfa-d525-4aa6-95c5-a377d875a049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:46 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Volume volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 (f8af61e2-7072-4501-8ad6-df7ebc0d5bd3): created successfully Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77ebfa-d525-4aa6-95c5-a377d875a049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:46 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Flow 'volume_create_manager' (e4c85979-49e3-40d0-81a1-084aa07b05ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c365c861-54b9-4cf5-85a3-b3d62c552b98 tempest-VolumeDependencyTests-133220173 None] Created volume successfully. Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Creating offline snapshot 75b1d949-e793-40e3-b7b0-6c8d886394fb of volume f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0577efb-275a-422f-a851-cbdca78d56ce]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:47 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:30:47 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:47 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.399s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:47 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb 1G Sep 08 19:30:47 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (10895eb8-d539-4438-9ab9-cd8e82e2a9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81c068a-ba12-4736-85b0-611a0463441c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81c068a-ba12-4736-85b0-611a0463441c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1457570052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4df0ef-557b-42b5-96b0-8fc46963e1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e48d52c9-d7ca-4074-a9b6-935ad82519f8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:48Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a77d61-f7db-46e1-9be4-ca7549059e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a77d61-f7db-46e1-9be4-ca7549059e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b663d673-39eb-4c5f-bf26-693fd9b5e68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b663d673-39eb-4c5f-bf26-693fd9b5e68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f4df0ef-557b-42b5-96b0-8fc46963e1f3', 'volume_name': 'volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3', 'volume_size': 2, 'snapshot_id': 'e48d52c9-d7ca-4074-a9b6-935ad82519f8'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6d1661-a8bd-4c50-b56e-5c89fb65cd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6d1661-a8bd-4c50-b56e-5c89fb65cd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11e0760-280f-4ea1-a8d7-f75d4fa09408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:47 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Volume 8f4df0ef-557b-42b5-96b0-8fc46963e1f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3', 'volume_size': 2, 'snapshot_id': 'e48d52c9-d7ca-4074-a9b6-935ad82519f8'} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:47 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb 1G" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:48 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:30:48 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:48 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.293s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:48 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb is being set with open permissions: ugo+rw Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:48 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:30:48 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:48 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:48 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info Sep 08 19:30:48 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:48 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info" returned: 0 in 0.253s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:48 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info is being set with open permissions: ugo+rw Sep 08 19:30:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:48 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info Sep 08 19:30:48 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:49 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.info" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.915s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.309s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Creating volume 8f4df0ef-557b-42b5-96b0-8fc46963e1f3 from snapshot e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-76c0a3a4-f40d-4267-9aa5-3dd435cf8d89 tempest-VolumeDependencyTests-133220173 None] Create snapshot completed successfully Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] snapshot: e48d52c9-d7ca-4074-a9b6-935ad82519f8, volume: 8f4df0ef-557b-42b5-96b0-8fc46963e1f3, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[804cfa43-6ba2-4c0b-a8e2-9ac3f8c1bb29]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:49 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:30:49 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:49 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[089fbc9a-c60e-4f05-96f1-09045942c18a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:49 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:30:49 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Flow 'volume_create_manager' (e2fae6f6-2b0e-47f0-9e35-3764794768e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5552a5c0-2ca4-404c-b523-a6ffb7c1b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5552a5c0-2ca4-404c-b523-a6ffb7c1b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1733381042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e68e8cb-85c2-4798-9bc1-758f8ad5efee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79cb35e28d0b45bf8f1ee1bd97eca610',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=75b1d949-e793-40e3-b7b0-6c8d886394fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:30:50Z,use_quota=True,user_id='f8e33f520d9a4e0f98010c8c4dfd9590',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0875473d-16e8-4209-900b-32b890c656f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0875473d-16e8-4209-900b-32b890c656f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c3a28c-60ad-4490-92b2-35d8ceee2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c3a28c-60ad-4490-92b2-35d8ceee2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e68e8cb-85c2-4798-9bc1-758f8ad5efee', 'volume_name': 'volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee', 'volume_size': 1, 'snapshot_id': '75b1d949-e793-40e3-b7b0-6c8d886394fb'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c02cfba-8800-4994-a5e1-fc40f0302203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c02cfba-8800-4994-a5e1-fc40f0302203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ed958c-ddb6-4be5-a2fd-7d70bfc544ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Volume 2e68e8cb-85c2-4798-9bc1-758f8ad5efee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee', 'volume_size': 1, 'snapshot_id': '75b1d949-e793-40e3-b7b0-6c8d886394fb'} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:49 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.388s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:30:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:49 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 Sep 08 19:30:49 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:54 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" returned: 0 in 4.160s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc, size 1024.00 MB, duration 4.16 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:30:54 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Converted 1024.00 MB image at 246.09 MB/s Sep 08 19:30:54 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 is being set with open permissions: ugo+rw Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:54 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 Sep 08 19:30:54 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:54 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" released by "_copy_volume_from_snapshot" :: held 5.244s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" released by "_create_volume_from_snapshot" :: held 5.305s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.330s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.507s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Creating volume 2e68e8cb-85c2-4798-9bc1-758f8ad5efee from snapshot 75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b11e0760-280f-4ea1-a8d7-f75d4fa09408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3', 'volume_size': 2, 'snapshot_id': 'e48d52c9-d7ca-4074-a9b6-935ad82519f8'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6ce76-e38a-40d1-85a6-e8ffeac3407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] snapshot: 75b1d949-e793-40e3-b7b0-6c8d886394fb, volume: 2e68e8cb-85c2-4798-9bc1-758f8ad5efee, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:30:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Volume volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 (8f4df0ef-557b-42b5-96b0-8fc46963e1f3): created successfully Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f6ce76-e38a-40d1-85a6-e8ffeac3407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (10895eb8-d539-4438-9ab9-cd8e82e2a9e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9bb06-d26c-43cc-a8a4-a98013bd5a5d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-343d1301-8dde-4d40-be8d-28e1f36c1496 tempest-VolumesSnapshotTestJSON-76797717 None] Created volume successfully. Sep 08 19:30:54 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:30:54 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:54 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77b82a3-b872-44a4-a147-db456ad563cd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:55 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:30:55 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:55 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:55 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee Sep 08 19:30:55 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-8f4df0ef-557b-42b5-96b0-8fc46963e1f3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-8f4df0ef-557b-42b5-96b0-8fc46963e1f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d7511-a0c4-4e89-9d3f-e141b31a7463]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:55 devstack sudo[104239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 Sep 08 19:30:55 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:56 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" returned: 0 in 0.851s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:56 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3 Sep 08 19:30:56 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:56 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" returned: 0 in 0.468s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-8f4df0ef-557b-42b5-96b0-8fc46963e1f3" released by "delete_volume" :: held 1.381s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:56 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['f912a1d1-84c6-4dea-89f3-140e89a018f7', '8f475a52-6fea-4904-90f6-73c766dbf7db', '984ed49c-dfa8-4ea6-91e4-f88c42a198a7', 'a202831d-3f2e-493e-9b60-5bcd525aea0b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:57 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:30:57 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:57 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.422s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:30:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Deleted volume successfully. Sep 08 19:30:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d87e5109-46dc-4a13-b5ee-29070f255f26 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-8f4df0ef-557b-42b5-96b0-8fc46963e1f3-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-e48d52c9-d7ca-4074-a9b6-935ad82519f8-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-e48d52c9-d7ca-4074-a9b6-935ad82519f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Deleting offline snapshot e48d52c9-d7ca-4074-a9b6-935ad82519f8 of volume d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] snapshot_file for this snap is: volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e028ea5-c3f1-41f9-ab23-3eb9a8b3acc6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:58 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:30:58 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:59 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 1.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a779745-2334-4fe4-85be-e9c87661789a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:59 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:30:59 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:30:59 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" returned: 0 in 4.602s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:30:59 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Converted 1024.00 MB image at 222.44 MB/s Sep 08 19:30:59 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee is being set with open permissions: ugo+rw Sep 08 19:30:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:30:59 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee Sep 08 19:30:59 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:00 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" released by "_copy_volume_from_snapshot" :: held 5.673s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" released by "_create_volume_from_snapshot" :: held 5.747s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.766s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ed958c-ddb6-4be5-a2fd-7d70bfc544ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee', 'volume_size': 1, 'snapshot_id': '75b1d949-e793-40e3-b7b0-6c8d886394fb'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e747497e-95b8-4d0a-be06-6483246076dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Volume volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee (2e68e8cb-85c2-4798-9bc1-758f8ad5efee): created successfully Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e747497e-95b8-4d0a-be06-6483246076dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:00 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Flow 'volume_create_manager' (e2fae6f6-2b0e-47f0-9e35-3764794768e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.720s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:00 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:31:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-68632b10-278a-4577-a74a-f4cf76377421 tempest-VolumeDependencyTests-133220173 None] Created volume successfully. Sep 08 19:31:00 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:00 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:00 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8 Sep 08 19:31:00 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-75b1d949-e793-40e3-b7b0-6c8d886394fb-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:00 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc.e48d52c9-d7ca-4074-a9b6-935ad82519f8" returned: 0 in 0.263s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-75b1d949-e793-40e3-b7b0-6c8d886394fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-e48d52c9-d7ca-4074-a9b6-935ad82519f8" released by "_delete_snapshot" :: held 2.749s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" released by "delete_snapshot" :: held 2.809s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Deleting offline snapshot 75b1d949-e793-40e3-b7b0-6c8d886394fb of volume f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] snapshot_file for this snap is: volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cabe32f-c1f6-4260-8b4c-ec3af7651cc6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:00 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['6ab0267c-98c1-4855-b0ce-ac5d04266d67', '42a34100-5a22-479c-b0ed-9ba7c59ec0a1', '47418473-4ac7-4316-acff-7ecb086539fd', 'efbeb7de-dc8a-4925-a64f-9e6b97a6993f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Delete snapshot completed successfully. Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-29702c35-d102-4165-b5e6-01e3aae86d06 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-e48d52c9-d7ca-4074-a9b6-935ad82519f8-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:01 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:31:01 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:01 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40f6056-0df8-4948-a19e-625e49e41954]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:01 devstack sudo[104289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:31:01 devstack sudo[104289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9cb5e6-8829-440a-9655-a68382300370]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:01 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:31:01 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:01 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.361s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:01 devstack sudo[104289]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.551s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:01 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc Sep 08 19:31:01 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:01 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:31:01 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:02 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc" released by "delete_volume" :: held 0.682s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['3128ed5f-5143-4ee7-87ff-57b5a5ea1bc6', '187b076d-f7df-4489-9198-ab88a57d055c', '013ca337-2c2c-46c1-b204-00bc45dbb25c', 'f6048511-b8da-48d5-806b-2fd8340c85b2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:02 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:02 devstack sudo[104309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb Sep 08 19:31:02 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:02 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:02 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:02 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3.75b1d949-e793-40e3-b7b0-6c8d886394fb" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-75b1d949-e793-40e3-b7b0-6c8d886394fb" released by "_delete_snapshot" :: held 1.644s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" released by "delete_snapshot" :: held 1.678s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:02 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Deleted volume successfully. Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7672321f-b2df-4aaf-a65d-c74ea5076002 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-d563f479-b0e4-4ebe-a09f-2c9e4bcd3efc-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Created reservations ['8f6d5117-a404-44d2-b3cf-2595bf4b4cc2', 'f345396e-9027-44e0-95ab-3020bcf8c654', '4892f242-bbf5-4c0d-9076-5355f191b69d', '3ea56eb5-16e3-40b2-b156-6068e19ca07f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Delete snapshot completed successfully. Sep 08 19:31:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-57ce7ffc-b883-4f66-a146-8b8309e62d4e tempest-VolumeDependencyTests-133220173 None] Lock "cinder-75b1d949-e793-40e3-b7b0-6c8d886394fb-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (1e121081-f5b0-4ea7-8f55-4c308399b6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f789066-79de-4298-a209-750305a50cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f789066-79de-4298-a209-750305a50cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1871405503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf354b8-b7d1-4fba-aabf-75da80bd7f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:03Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2002293f-ee74-42b6-904e-a3430082456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2002293f-ee74-42b6-904e-a3430082456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ffecc1-5f6a-4e6c-bada-cd8bd0c06a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6ffecc1-5f6a-4e6c-bada-cd8bd0c06a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf354b8-b7d1-4fba-aabf-75da80bd7f59', 'volume_name': 'volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ed2cf-dfbc-44ca-8053-031a1532c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2ed2cf-dfbc-44ca-8053-031a1532c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e1aee5-edd8-4086-bbdd-10697ab0f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Volume dcf354b8-b7d1-4fba-aabf-75da80bd7f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59', 'volume_size': 1} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1871405503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf354b8-b7d1-4fba-aabf-75da80bd7f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:03Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Creating volume dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:03 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" acquired by "delete_volume" :: waited 0.082s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:03 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 1073741824 Sep 08 19:31:03 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d94e20-a74d-467b-962d-78b09bbf7f02]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:03 devstack sudo[104317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:31:03 devstack sudo[104317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:03 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 1073741824" returned: 0 in 0.416s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:03 devstack sudo[104317]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.371s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:03 devstack sudo[104325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3 Sep 08 19:31:03 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:03 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:03 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:03 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" returned: 0 in 0.247s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3" released by "delete_volume" :: held 0.677s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:03 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.264s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Created reservations ['f90f7d33-3ed0-4fa4-b954-894641c838e2', 'dade9a6d-48a5-49ad-bcdf-2e76a95efb39', '6ac681b4-e148-42aa-94e2-e487c8ef1643', 'ad93d60d-3e28-4431-ba18-8f685ca8e676'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e1aee5-edd8-4086-bbdd-10697ab0f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7b2b9b-9c30-40f0-af8c-3ba2538b5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:03 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Volume volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 (dcf354b8-b7d1-4fba-aabf-75da80bd7f59): created successfully Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7b2b9b-9c30-40f0-af8c-3ba2538b5062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:03 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (1e121081-f5b0-4ea7-8f55-4c308399b6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5d2a1704-1f84-4ecc-bb01-5b00c963f5ee tempest-VolumesSnapshotTestJSON-76797717 None] Created volume successfully. Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:04 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:04 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-2e68e8cb-85c2-4798-9bc1-758f8ad5efee-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-2e68e8cb-85c2-4798-9bc1-758f8ad5efee-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:04 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Creating offline snapshot c648a92d-7725-4667-8fc0-a7e41ffccff4 of volume dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" acquired by "delete_volume" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.331s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e57c08-7a44-438f-94d4-bda77abcf331]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Deleted volume successfully. Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[131cefe7-5e8b-4f42-8840-71883295fb4c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ab521381-a67b-47a8-b99c-41657d389e92 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-f8af61e2-7072-4501-8ad6-df7ebc0d5bd3-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:04 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:04 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:04 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee Sep 08 19:31:04 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:04 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:04 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:04 devstack sudo[104344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 1G Sep 08 19:31:04 devstack sudo[104344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:04 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee Sep 08 19:31:04 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:04 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-quobyte-2e68e8cb-85c2-4798-9bc1-758f8ad5efee" released by "delete_volume" :: held 0.661s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Created reservations ['c0741d70-a4b8-485a-9bfa-8479ddd324de', 'c00f1117-6fec-4b2e-971f-f60e029da5dc', 'd49b7c80-0946-4f46-a06c-9541034df980', '026ee449-f401-4831-a285-a05eaace2e7b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:05 devstack sudo[104344]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 1G" returned: 0 in 0.413s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:05 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:05 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:05 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:05 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:05 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Deleted volume successfully. Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-48f6a748-6ec2-4d99-8cf4-c545491b6666 tempest-VolumeDependencyTests-133220173 None] Lock "cinder-2e68e8cb-85c2-4798-9bc1-758f8ad5efee-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:05 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:05 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 is being set with open permissions: ugo+rw Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:05 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:05 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:05 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:05 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info Sep 08 19:31:05 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:06 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:06 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info is being set with open permissions: ugo+rw Sep 08 19:31:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:06 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info Sep 08 19:31:06 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:06 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.info" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7cfb2960-ae94-42a1-b2fe-bc3451bf3e72 tempest-VolumesSnapshotTestJSON-76797717 None] Create snapshot completed successfully Sep 08 19:31:07 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (11ca4b1f-c812-4fe7-82a5-d68933446126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05fa9dc-6cfd-4fb6-812d-a9ffe1286603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05fa9dc-6cfd-4fb6-812d-a9ffe1286603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-82169746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61a6d451f214da69fd5ba7e5cb2a867',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c648a92d-7725-4667-8fc0-a7e41ffccff4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:08Z,use_quota=True,user_id='afc4ed6fca5449fcab03ac8eacd69b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a07845-d857-4b5b-936f-45bd38a1610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8a07845-d857-4b5b-936f-45bd38a1610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd5a987-269e-404a-baa7-25ad6a47bd5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dd5a987-269e-404a-baa7-25ad6a47bd5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd', 'volume_name': 'volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd', 'volume_size': 1, 'snapshot_id': 'c648a92d-7725-4667-8fc0-a7e41ffccff4'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79aeae-c62c-404a-9893-e2a75bae7576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc79aeae-c62c-404a-9893-e2a75bae7576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046de531-1a95-4624-a8e7-b905282b3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:08 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Volume db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd', 'volume_size': 1, 'snapshot_id': 'c648a92d-7725-4667-8fc0-a7e41ffccff4'} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Creating volume db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd from snapshot c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] snapshot: c648a92d-7725-4667-8fc0-a7e41ffccff4, volume: db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c51e8a-8112-466c-95f0-9ff2e70ce22b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:08 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:08 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:08 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2a7dc1-9650-4cff-b77b-c8434e02e793]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:08 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:08 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:08 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:31:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:08 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd Sep 08 19:31:08 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:13 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" returned: 0 in 4.847s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:13 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59, size 1024.00 MB, duration 4.85 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:31:13 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Converted 1024.00 MB image at 211.22 MB/s Sep 08 19:31:13 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd is being set with open permissions: ugo+rw Sep 08 19:31:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:13 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd Sep 08 19:31:13 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:14 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" released by "_copy_volume_from_snapshot" :: held 5.951s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" released by "_create_volume_from_snapshot" :: held 6.027s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.044s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (046de531-1a95-4624-a8e7-b905282b3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd', 'volume_size': 1, 'snapshot_id': 'c648a92d-7725-4667-8fc0-a7e41ffccff4'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc350a06-9c5c-4ff3-a64e-5e03a43f6013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:14 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Volume volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd (db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd): created successfully Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc350a06-9c5c-4ff3-a64e-5e03a43f6013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Flow 'volume_create_manager' (11ca4b1f-c812-4fe7-82a5-d68933446126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7b169f23-97dd-4594-9b81-9070ea95d1e4 tempest-VolumesSnapshotTestJSON-76797717 None] Created volume successfully. Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[390800ad-6f0d-4b23-84dc-fce3dffe9093]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:14 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd Sep 08 19:31:14 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:15 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:15 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:15 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" returned: 0 in 0.377s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:15 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd Sep 08 19:31:15 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:15 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:31:15 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd" released by "delete_volume" :: held 0.675s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=113,cinder:UPDATE=107,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=97,cinder:UPDATE=108,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['2e5dde9c-0c74-4f31-bf0b-101ca934f0d5', '7f34c688-a912-4901-9b09-28a02c9e89f8', 'ca699515-8077-4554-acd6-b375137456bd', '070224d0-d9b7-4492-afb0-b1a7981b8890'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:15 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:15 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:15 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Deleted volume successfully. Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f1dd3243-accc-4023-899b-5fe39eaaccfe tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-db6aa7f0-df34-4e46-b4ac-5bdcc2e8c3dd-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-c648a92d-7725-4667-8fc0-a7e41ffccff4-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-c648a92d-7725-4667-8fc0-a7e41ffccff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Deleting offline snapshot c648a92d-7725-4667-8fc0-a7e41ffccff4 of volume dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] snapshot_file for this snap is: volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257f091-773e-4e9a-9aa4-44f9da8d69bd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:16 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:16 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:16 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.379s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a118d3-e599-4162-8779-2adae25ece4b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (2360e713-caed-495d-9cbf-34b07baa62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e3ff9c-5b63-46bd-a2a1-7af2bb3a1123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e3ff9c-5b63-46bd-a2a1-7af2bb3a1123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404077018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f880e-65a7-4246-a3bd-2dc31918b410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:16Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554f554c-2c96-4498-96a0-f43c981a5c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:16 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:16 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554f554c-2c96-4498-96a0-f43c981a5c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b277a-abad-4711-aad1-55315d930b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c0b277a-abad-4711-aad1-55315d930b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42f880e-65a7-4246-a3bd-2dc31918b410', 'volume_name': 'volume-f42f880e-65a7-4246-a3bd-2dc31918b410', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5c7188-d5a8-4070-9146-e52aa3bbbf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5c7188-d5a8-4070-9146-e52aa3bbbf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87886f01-e9a8-49da-8943-10f71fd285c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Volume f42f880e-65a7-4246-a3bd-2dc31918b410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42f880e-65a7-4246-a3bd-2dc31918b410', 'volume_size': 1} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404077018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f880e-65a7-4246-a3bd-2dc31918b410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:16Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Creating volume f42f880e-65a7-4246-a3bd-2dc31918b410 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:16 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:16 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 1073741824 Sep 08 19:31:16 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:16 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:16 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 1073741824" returned: 0 in 0.411s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.564s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:16 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:16 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:17 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 Sep 08 19:31:17 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:17 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410" returned: 0 in 0.249s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87886f01-e9a8-49da-8943-10f71fd285c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42f880e-65a7-4246-a3bd-2dc31918b410', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4b051-2745-466b-b954-18d1baa32717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Volume volume-f42f880e-65a7-4246-a3bd-2dc31918b410 (f42f880e-65a7-4246-a3bd-2dc31918b410): created successfully Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e4b051-2745-466b-b954-18d1baa32717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (2360e713-caed-495d-9cbf-34b07baa62e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:17 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.340s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-55c3ec79-7848-4cd2-8d77-48d5e89c12cb tempest-ProjectReaderTests-1849378507 None] Created volume successfully. Sep 08 19:31:17 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4 Sep 08 19:31:17 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:17 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59.c648a92d-7725-4667-8fc0-a7e41ffccff4" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-f42f880e-65a7-4246-a3bd-2dc31918b410-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-c648a92d-7725-4667-8fc0-a7e41ffccff4" released by "_delete_snapshot" :: held 1.634s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" released by "delete_snapshot" :: held 1.660s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-f42f880e-65a7-4246-a3bd-2dc31918b410-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-quobyte-f42f880e-65a7-4246-a3bd-2dc31918b410" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-f42f880e-65a7-4246-a3bd-2dc31918b410" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2414fb5-187b-458c-ab09-dbde450bb9bd]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['389785f7-dcef-4341-a114-b7106646166d', '016b2072-826c-48e4-a370-eb4d98bb04f6', '46a5aa02-715c-4a6c-baac-9f6583a33a15', '56665547-efd1-4cfb-94fb-9b2debf24285'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Delete snapshot completed successfully. Sep 08 19:31:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c22a20bb-bd91-4f45-af9c-7f3498c45643 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-c648a92d-7725-4667-8fc0-a7e41ffccff4-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:17 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 Sep 08 19:31:17 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:18 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:18 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410 Sep 08 19:31:18 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-dcf354b8-b7d1-4fba-aabf-75da80bd7f59-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-dcf354b8-b7d1-4fba-aabf-75da80bd7f59-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398aeac-3775-418d-ba9e-334833eb305b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:18 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-f42f880e-65a7-4246-a3bd-2dc31918b410" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-f42f880e-65a7-4246-a3bd-2dc31918b410" released by "delete_volume" :: held 0.682s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:18 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:18 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Created reservations ['b0b640b0-1950-416b-95e8-06b1c229ceb8', 'd92662a0-e672-4d53-b08e-eef514f2e0b5', 'fd60fdc2-75a0-4bc4-a0e2-f51efedd9394', 'cb7377c3-ea12-480b-b38d-a13085841c3a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:18 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:18 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:18 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.391s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:18 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59 Sep 08 19:31:18 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:18 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.288s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Deleted volume successfully. Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-84370bb3-c323-4f43-a6bb-c3520edefa80 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-f42f880e-65a7-4246-a3bd-2dc31918b410-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:18 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" returned: 0 in 0.313s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-dcf354b8-b7d1-4fba-aabf-75da80bd7f59" released by "delete_volume" :: held 0.771s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['663e296b-5563-458a-847a-b716cb2f85fb', 'eb009d44-27c9-4397-b893-7914ab03b358', 'cc153329-a95d-443d-9ad0-6ae522d60f39', 'e9719571-a166-4275-b776-e29074b4f475'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:19 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:19 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (d698b2d4-e108-4a73-966f-4af8018d81f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9263685-4af7-4fee-ab58-db8cc4b4a5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9263685-4af7-4fee-ab58-db8cc4b4a5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993641013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317eb7dc-8596-4f9d-a69c-722ca4322233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:19Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1e18ec-400e-4527-b6ca-89289ab27a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a1e18ec-400e-4527-b6ca-89289ab27a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e605b-6570-4a70-a1bf-4e5562ed8807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279e605b-6570-4a70-a1bf-4e5562ed8807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '317eb7dc-8596-4f9d-a69c-722ca4322233', 'volume_name': 'volume-317eb7dc-8596-4f9d-a69c-722ca4322233', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24d458c-17e2-4b1a-a5dc-72772d57b98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24d458c-17e2-4b1a-a5dc-72772d57b98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9cc2e9-49c8-438b-a927-0904e4c49c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:19 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Volume 317eb7dc-8596-4f9d-a69c-722ca4322233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-317eb7dc-8596-4f9d-a69c-722ca4322233', 'volume_size': 1} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-993641013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=317eb7dc-8596-4f9d-a69c-722ca4322233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:19Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Creating volume 317eb7dc-8596-4f9d-a69c-722ca4322233 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:19 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-03f3efe2-c5cc-4236-b366-bf50a4ea834a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:19 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:19 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 1073741824 Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-03f3efe2-c5cc-4236-b366-bf50a4ea834a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:19 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Deleted volume successfully. Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-509c73be-633b-43c5-8478-7aff6c2709e6 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-dcf354b8-b7d1-4fba-aabf-75da80bd7f59-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[784bbf02-0679-4959-ad30-b403faa8d3a8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:19 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a Sep 08 19:31:19 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:19 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 1073741824" returned: 0 in 0.430s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:19 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 Sep 08 19:31:19 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:19 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:19 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a Sep 08 19:31:19 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:20 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9cc2e9-49c8-438b-a927-0904e4c49c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-317eb7dc-8596-4f9d-a69c-722ca4322233', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb0274-9ea8-4bcd-a5ac-3cbfbe573a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:20 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Volume volume-317eb7dc-8596-4f9d-a69c-722ca4322233 (317eb7dc-8596-4f9d-a69c-722ca4322233): created successfully Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbb0274-9ea8-4bcd-a5ac-3cbfbe573a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (d698b2d4-e108-4a73-966f-4af8018d81f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f51f0b9b-ef47-413c-bb52-4bf390bbc6db tempest-ProjectReaderTests-1849378507 None] Created volume successfully. Sep 08 19:31:20 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-03f3efe2-c5cc-4236-b366-bf50a4ea834a" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-quobyte-03f3efe2-c5cc-4236-b366-bf50a4ea834a" released by "delete_volume" :: held 0.730s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Created reservations ['dda4fe61-f564-484b-9192-b5188d05cdb7', '5b2e1fe0-94d7-404a-92ff-abafc3ae8c52', '77f3c112-224a-4945-8faa-590781bead1d', 'bdbc1d35-45a6-4d0f-98b5-5a05bb77df9a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-317eb7dc-8596-4f9d-a69c-722ca4322233-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:20 devstack sudo[104479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:20 devstack sudo[104479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "cinder-317eb7dc-8596-4f9d-a69c-722ca4322233-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-quobyte-317eb7dc-8596-4f9d-a69c-722ca4322233" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-317eb7dc-8596-4f9d-a69c-722ca4322233" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03d033b-76f4-4de7-bee7-fefc6ea1b1be]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:20 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 Sep 08 19:31:20 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:20 devstack sudo[104479]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.295s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Deleted volume successfully. Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-02c2594a-98a5-4db2-a76f-fcec85b15c80 tempest-VolumesSnapshotTestJSON-76797717 None] Lock "cinder-03f3efe2-c5cc-4236-b366-bf50a4ea834a-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:20 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233" returned: 0 in 0.382s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:20 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233 Sep 08 19:31:20 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:21 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-317eb7dc-8596-4f9d-a69c-722ca4322233" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-317eb7dc-8596-4f9d-a69c-722ca4322233" released by "delete_volume" :: held 0.673s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Created reservations ['1b375090-cf34-4648-b011-e261bd5b74bb', 'ed85d40c-b57e-46cb-aeae-8d76b3b2f800', '68017c7f-82f1-4953-9f78-7a94d9d5ac9f', 'c4b9c289-f401-45b7-8ccc-2d2156502622'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:21 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:21 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:21 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Deleted volume successfully. Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aaf27ca7-5c8a-4477-ab4e-f2b8b4fdbe1a tempest-ProjectReaderTests-1849378507 None] Lock "cinder-317eb7dc-8596-4f9d-a69c-722ca4322233-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (a8001b9c-6da7-4c4d-a3b0-0b51e90cf53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:21 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c2d698-7410-4f0d-b722-c8e869612eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c2d698-7410-4f0d-b722-c8e869612eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672304880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebd82e9-6df5-4106-aeaa-20fc68ddf1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:22Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c36c5bb-09fe-45e6-acbb-7ec901a62c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c36c5bb-09fe-45e6-acbb-7ec901a62c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec45753a-3bd0-4034-b5d4-26c7b05aa910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec45753a-3bd0-4034-b5d4-26c7b05aa910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebd82e9-6df5-4106-aeaa-20fc68ddf1b5', 'volume_name': 'volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b606b0ba-a725-42d2-9b01-d1c4356c65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b606b0ba-a725-42d2-9b01-d1c4356c65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d50a08-63d4-45d5-a0d1-708bcf618720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Volume eebd82e9-6df5-4106-aeaa-20fc68ddf1b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5', 'volume_size': 1} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672304880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebd82e9-6df5-4106-aeaa-20fc68ddf1b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:22Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Creating volume eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:22 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:22 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 1073741824 Sep 08 19:31:22 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:22 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 1073741824" returned: 0 in 0.437s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:22 devstack sudo[104500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 Sep 08 19:31:22 devstack sudo[104500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:22 devstack sudo[104500]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d50a08-63d4-45d5-a0d1-708bcf618720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39eea92-8838-4e5a-be8f-958cbbeac36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:22 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Volume volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 (eebd82e9-6df5-4106-aeaa-20fc68ddf1b5): created successfully Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39eea92-8838-4e5a-be8f-958cbbeac36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (a8001b9c-6da7-4c4d-a3b0-0b51e90cf53d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3e079e99-c98e-4e4b-b819-24a8a6b9bc07 tempest-ProjectReaderTests-1849378507 None] Created volume successfully. Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "cinder-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-quobyte-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a77e56b-17e7-4618-8bd4-0adab754902e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:23 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 Sep 08 19:31:23 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:23 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:23 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5 Sep 08 19:31:23 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:23 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5" released by "delete_volume" :: held 0.626s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Created reservations ['55e8271a-7e04-44ed-81e2-234074474b7a', 'add51017-6ee8-4828-8f79-58659b0350eb', 'db62a590-6d37-4ff1-835f-bcb6c21765fe', 'bb922462-e3d0-409c-b1f3-86d2474ed569'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:23 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:23 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:24 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.288s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Deleted volume successfully. Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fc5ada9d-496a-40f9-9bbb-67967de6aa5f tempest-ProjectReaderTests-1849378507 None] Lock "cinder-eebd82e9-6df5-4106-aeaa-20fc68ddf1b5-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (10dee60c-b8e6-4360-adfa-e72690b8f6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baacec11-8b16-4ea1-9ed1-1e8dc217f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baacec11-8b16-4ea1-9ed1-1e8dc217f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165813017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e6c5e-6335-440f-a6d6-5be06b9fadb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:25Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34675777-f260-49c4-a591-3027f331a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34675777-f260-49c4-a591-3027f331a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8ec5fe-354e-448a-a3f9-1d2ed430ddb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8ec5fe-354e-448a-a3f9-1d2ed430ddb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5e6c5e-6335-440f-a6d6-5be06b9fadb0', 'volume_name': 'volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e774ebed-da92-4b24-aa24-96be66881a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e774ebed-da92-4b24-aa24-96be66881a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a443b078-e0f9-47d2-974f-8c669f51da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Volume 4c5e6c5e-6335-440f-a6d6-5be06b9fadb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0', 'volume_size': 1} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165813017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5e6c5e-6335-440f-a6d6-5be06b9fadb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ce57c774034a3c82504a32b7e1cf12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:25Z,use_quota=True,user_id='0bf5498aa10d4ee79401e6b38b25883a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Creating volume 4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:24 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:24 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 1073741824 Sep 08 19:31:24 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:25 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 1073741824" returned: 0 in 0.440s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:25 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 Sep 08 19:31:25 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:25 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a443b078-e0f9-47d2-974f-8c669f51da91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15528592-7e91-4035-a61a-4d577067a718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:25 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Volume volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 (4c5e6c5e-6335-440f-a6d6-5be06b9fadb0): created successfully Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15528592-7e91-4035-a61a-4d577067a718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Flow 'volume_create_manager' (10dee60c-b8e6-4360-adfa-e72690b8f6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:25 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-97dfe6da-0b8e-4695-8521-6c3f34f02b49 tempest-ProjectReaderTests-1849378507 None] Created volume successfully. Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "cinder-quobyte-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f96d87-884a-4e0e-8177-591e39353d97]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:27 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 Sep 08 19:31:27 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:27 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" returned: 0 in 0.363s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:27 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0 Sep 08 19:31:27 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:27 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-quobyte-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0" released by "delete_volume" :: held 0.654s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Created reservations ['d923103e-492e-423e-aa19-879c0648c581', 'c075f1da-3cb0-49ae-b0eb-29a44d0b8e09', '27c4a323-6ab7-48f0-b6a4-0e76a37d1647', '1a49ca17-f9a6-4f4e-b422-cb7970318bef'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:27 devstack sudo[104534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:27 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Flow 'volume_create_manager' (10128f64-6419-4cb4-a696-b036435dcc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64fadcb-3c49-4c0f-bf09-1c16aefea891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f64fadcb-3c49-4c0f-bf09-1c16aefea891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-462809318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a252ae-5da5-4986-8b5f-1f8a0f375899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83085d9cac0643e58f571744a8f21a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:28Z,use_quota=True,user_id='e81e1b265cd44d6a8f6414670f6444e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c26873-2011-4538-a811-a36c8cac80ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2c26873-2011-4538-a811-a36c8cac80ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b3c94-92b0-4694-9b0a-ac99b50ac9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613b3c94-92b0-4694-9b0a-ac99b50ac9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a252ae-5da5-4986-8b5f-1f8a0f375899', 'volume_name': 'volume-62a252ae-5da5-4986-8b5f-1f8a0f375899', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0263959d-0acd-43b4-a92f-4c1f20534ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0263959d-0acd-43b4-a92f-4c1f20534ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219ca111-9f5e-43f6-b0c3-b7ac0b539445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:27 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Volume 62a252ae-5da5-4986-8b5f-1f8a0f375899: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a252ae-5da5-4986-8b5f-1f8a0f375899', 'volume_size': 1} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-462809318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a252ae-5da5-4986-8b5f-1f8a0f375899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83085d9cac0643e58f571744a8f21a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:31:28Z,use_quota=True,user_id='e81e1b265cd44d6a8f6414670f6444e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Creating volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:31:27 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:27 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 1073741824 Sep 08 19:31:27 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:27 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Deleted volume successfully. Sep 08 19:31:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fd723925-47f1-4c88-9a31-ef4ddbed77c9 tempest-ProjectReaderTests-1849378507 None] Lock "cinder-4c5e6c5e-6335-440f-a6d6-5be06b9fadb0-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:28 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 1073741824" returned: 0 in 0.450s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:28 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 Sep 08 19:31:28 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:28 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219ca111-9f5e-43f6-b0c3-b7ac0b539445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a252ae-5da5-4986-8b5f-1f8a0f375899', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf237c4-55c3-41b0-b4ab-bee918f69af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:31:28 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Volume volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 (62a252ae-5da5-4986-8b5f-1f8a0f375899): created successfully Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf237c4-55c3-41b0-b4ab-bee918f69af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Flow 'volume_create_manager' (10128f64-6419-4cb4-a696-b036435dcc4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:31:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-55733629-7182-437c-8f8c-78bf6bfcb9ac tempest-VolumesSnapshotListTestJSON-450760934 None] Created volume successfully. Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Creating offline snapshot 29b93f4d-fc51-4e7c-93c0-d4862c560514 of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[981fc674-cc91-4666-a546-c4dbf824587b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:29 devstack sudo[104547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 Sep 08 19:31:29 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:29 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899" returned: 0 in 0.398s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:29 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 1G Sep 08 19:31:29 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:29 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 1G" returned: 0 in 0.411s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:29 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:29 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:30 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.299s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:30 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 is being set with open permissions: ugo+rw Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:30 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:30 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:30 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:30 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info Sep 08 19:31:30 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:30 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info" returned: 0 in 0.253s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:30 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info is being set with open permissions: ugo+rw Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:30 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info Sep 08 19:31:30 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:30 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.info" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8180d247-c5a0-4aa6-b6f1-25a095d1fcf2 tempest-VolumesSnapshotListTestJSON-450760934 None] Create snapshot completed successfully Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Creating offline snapshot 68febcf9-683e-4cd0-a502-d15b8c4cbf49 of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0f4716-765e-4c94-aa90-bc950750b723]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:31 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:31 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:31 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:31 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 1G Sep 08 19:31:31 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:32 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 1G" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:32 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:32 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:32 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.284s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:32 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 is being set with open permissions: ugo+rw Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:32 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:32 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:32 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.233s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.335s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:32 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e3e6039c-e559-42d6-a84c-46ae9260fafa tempest-VolumesSnapshotListTestJSON-450760934 None] Create snapshot completed successfully Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Creating offline snapshot 097fd40e-6777-4919-87cc-535378c795ea of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[87aedffc-5198-4025-bf14-1ae75f06f5d1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:33 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:33 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:33 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.349s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:33 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea 1G Sep 08 19:31:33 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:34 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea 1G" returned: 0 in 0.423s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:34 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea Sep 08 19:31:34 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:34 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:34 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea is being set with open permissions: ugo+rw Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:34 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea Sep 08 19:31:34 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:34 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.370s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-17ece5c0-7600-4b9a-9353-36e0301f6e00 tempest-VolumesSnapshotListTestJSON-450760934 None] Create snapshot completed successfully Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-097fd40e-6777-4919-87cc-535378c795ea-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-097fd40e-6777-4919-87cc-535378c795ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-097fd40e-6777-4919-87cc-535378c795ea" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-097fd40e-6777-4919-87cc-535378c795ea" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Deleting offline snapshot 097fd40e-6777-4919-87cc-535378c795ea of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] snapshot_file for this snap is: volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[45560691-44b9-4746-b483-9dd9f51f7698]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:36 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea Sep 08 19:31:36 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:36 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea" returned: 0 in 0.339s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca52c759-0ada-42c9-b731-465fb7584dd4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:37 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:37 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:37 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.341s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:37 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea Sep 08 19:31:37 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:37 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea" returned: 0 in 0.376s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:37 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea Sep 08 19:31:37 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:37 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.097fd40e-6777-4919-87cc-535378c795ea" returned: 0 in 0.232s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-097fd40e-6777-4919-87cc-535378c795ea" released by "_delete_snapshot" :: held 1.369s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" released by "delete_snapshot" :: held 1.391s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Created reservations ['130c8918-595d-4da9-ae41-acab34c1d4fa', '2800c944-3edc-4319-9a56-17a5464b3b8b', 'd4ce3fad-dda8-4d93-b8c1-49d6c12185e4', '962f975d-ce41-4a6a-b015-53856800a709'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Delete snapshot completed successfully. Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e4c4a375-cc6d-4521-b535-f503a02c79de tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-097fd40e-6777-4919-87cc-535378c795ea-delete_snapshot" released by "delete_snapshot" :: held 1.526s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-68febcf9-683e-4cd0-a502-d15b8c4cbf49-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-68febcf9-683e-4cd0-a502-d15b8c4cbf49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-68febcf9-683e-4cd0-a502-d15b8c4cbf49" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-68febcf9-683e-4cd0-a502-d15b8c4cbf49" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Deleting offline snapshot 68febcf9-683e-4cd0-a502-d15b8c4cbf49 of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] snapshot_file for this snap is: volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9257390-0198-4215-947e-a7bdde46eae9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:38 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:38 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:39 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e06112-fc6d-4c05-b274-154d69248d61]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:39 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:39 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:39 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:39 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:39 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:39 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:39 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49 Sep 08 19:31:39 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:40 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.68febcf9-683e-4cd0-a502-d15b8c4cbf49" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-68febcf9-683e-4cd0-a502-d15b8c4cbf49" released by "_delete_snapshot" :: held 1.384s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" released by "delete_snapshot" :: held 1.405s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Created reservations ['5ff150df-6e64-4d45-909a-3c653662ffd9', '3d13172e-cc12-4c15-b061-a45f2f8aefbb', '867d9913-98fd-4a41-bd4f-b2d643f62986', '7338247d-2912-40f4-957b-63cda7164ec0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Delete snapshot completed successfully. Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0ef39067-6d00-40c8-b404-e81a4a2f6c54 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-68febcf9-683e-4cd0-a502-d15b8c4cbf49-delete_snapshot" released by "delete_snapshot" :: held 1.535s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-29b93f4d-fc51-4e7c-93c0-d4862c560514-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-29b93f4d-fc51-4e7c-93c0-d4862c560514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-29b93f4d-fc51-4e7c-93c0-d4862c560514" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-29b93f4d-fc51-4e7c-93c0-d4862c560514" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Deleting offline snapshot 29b93f4d-fc51-4e7c-93c0-d4862c560514 of volume 62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] snapshot_file for this snap is: volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b6a7e2-353f-42fa-ae52-04b9075a5d6d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:41 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:41 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:41 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62a252ae-5da5-4986-8b5f-1f8a0f375899(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1dfa4f-07ec-426d-baee-0e07d5169b1c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:41 devstack sudo[104652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 Sep 08 19:31:41 devstack sudo[104652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:41 devstack sudo[104652]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:41 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:41 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:41 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.328s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:41 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514 Sep 08 19:31:41 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:42 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899.29b93f4d-fc51-4e7c-93c0-d4862c560514" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-29b93f4d-fc51-4e7c-93c0-d4862c560514" released by "_delete_snapshot" :: held 1.347s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" released by "delete_snapshot" :: held 1.368s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Created reservations ['6ab6c00a-8e5a-446d-95e2-547220e5f58f', 'bf0eec82-5c09-4b67-adc1-3db691e9c75f', 'b57fb563-5c94-409f-bcd0-79b31bf54802', '81aa5b23-c70c-44ca-8a8b-2588cc1fc404'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Delete snapshot completed successfully. Sep 08 19:31:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-20f9315c-b82b-4da1-a247-f5b011241797 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-29b93f4d-fc51-4e7c-93c0-d4862c560514-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-62a252ae-5da5-4986-8b5f-1f8a0f375899-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-62a252ae-5da5-4986-8b5f-1f8a0f375899-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b54ef-d833-4492-a4c9-916e78b9f0fa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:43 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 Sep 08 19:31:43 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:43 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:43 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899 Sep 08 19:31:43 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:43 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-62a252ae-5da5-4986-8b5f-1f8a0f375899" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-quobyte-62a252ae-5da5-4986-8b5f-1f8a0f375899" released by "delete_volume" :: held 0.641s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Created reservations ['67adde0d-2435-4a90-b31c-1f029047d616', '908e052e-92a4-4814-a928-f7646f47161a', '194ce3f1-77ad-4481-8029-de3f272230c4', 'c140262e-b25c-45d9-bb44-f3a4c915fbea'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:31:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:31:43 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:31:43 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:31:44 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Sep 08 19:31:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:31:44 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:31:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Deleted volume successfully. Sep 08 19:31:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-09996d22-9150-4be1-9ab7-0092289a9e44 tempest-VolumesSnapshotListTestJSON-450760934 None] Lock "cinder-62a252ae-5da5-4986-8b5f-1f8a0f375899-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:31:53 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=82,cinder:INSERT=33,cinder:UPDATE=102,cinder:DELETE=6 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:31:54 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=106,cinder:SELECT=71,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:32:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:32:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:32:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:32:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:32:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:32:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:32:15 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:32:15 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:32:15 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.270s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Flow 'volume_create_manager' (acd24bf5-a98b-46c2-9f8d-a01c56aa5d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0869713-2e02-436c-a238-3a2a94e3caeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0869713-2e02-436c-a238-3a2a94e3caeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1384571569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ed998-5971-472d-9d56-22a74c538f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50b7befc33d40eda2b09eb03675621a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:32:16Z,use_quota=True,user_id='dc27a7f865ed4dd58e4355f18f84b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f8176d-6342-4917-b36d-22e31b07cade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58f8176d-6342-4917-b36d-22e31b07cade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288dea94-237e-4adf-873e-9d4dce35b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288dea94-237e-4adf-873e-9d4dce35b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8ed998-5971-472d-9d56-22a74c538f0a', 'volume_name': 'volume-1b8ed998-5971-472d-9d56-22a74c538f0a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75c0b7-3ebb-49a6-b789-c743e477c360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa75c0b7-3ebb-49a6-b789-c743e477c360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412562fa-c3e0-47fc-a7d2-9224a946c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:15 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Volume 1b8ed998-5971-472d-9d56-22a74c538f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8ed998-5971-472d-9d56-22a74c538f0a', 'volume_size': 1} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1384571569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8ed998-5971-472d-9d56-22a74c538f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50b7befc33d40eda2b09eb03675621a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:32:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:32:16Z,use_quota=True,user_id='dc27a7f865ed4dd58e4355f18f84b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Creating volume 1b8ed998-5971-472d-9d56-22a74c538f0a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:32:15 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:32:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:32:15 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a 1073741824 Sep 08 19:32:15 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:32:16 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a 1073741824" returned: 0 in 0.414s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:32:16 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a Sep 08 19:32:16 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:32:16 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412562fa-c3e0-47fc-a7d2-9224a946c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8ed998-5971-472d-9d56-22a74c538f0a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a211f9a-d709-4572-a126-f8d2fa990776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:32:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Volume volume-1b8ed998-5971-472d-9d56-22a74c538f0a (1b8ed998-5971-472d-9d56-22a74c538f0a): created successfully Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a211f9a-d709-4572-a126-f8d2fa990776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:32:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Flow 'volume_create_manager' (acd24bf5-a98b-46c2-9f8d-a01c56aa5d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:32:16 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-beaf27a4-f52c-41ae-af9b-3865527cd824 tempest-TestMinimumBasicScenario-800957085 None] Created volume successfully. Sep 08 19:32:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-28206374-9e91-451b-96d1-d728edf92898 req-eb814753-3e16-413f-8de9-8d864cf0d1f3 tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:32:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-28206374-9e91-451b-96d1-d728edf92898 req-eb814753-3e16-413f-8de9-8d864cf0d1f3 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:32:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-28206374-9e91-451b-96d1-d728edf92898 req-eb814753-3e16-413f-8de9-8d864cf0d1f3 tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:32:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-28206374-9e91-451b-96d1-d728edf92898 req-eb814753-3e16-413f-8de9-8d864cf0d1f3 tempest-TestMinimumBasicScenario-800957085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-1b8ed998-5971-472d-9d56-22a74c538f0a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55da5b5b-83ba-48af-8d00-336e70ab7c40', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:32:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-28206374-9e91-451b-96d1-d728edf92898 req-eb814753-3e16-413f-8de9-8d864cf0d1f3 tempest-TestMinimumBasicScenario-800957085 None] attachment_update completed successfully. Sep 08 19:32:27 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=4,cinder:SELECT=8 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:32:27 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:33:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:15 devstack sudo[105376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:33:15 devstack sudo[105376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:15 devstack sudo[105376]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.264s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:33:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:33:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:33:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:33:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-04f5d7b5-cef4-4172-ba30-3d7881ab45a8 req-29136f3a-6408-4cd4-a176-b76ad509b77a tempest-TestMinimumBasicScenario-800957085 None] Terminate volume connection completed successfully. Sep 08 19:33:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-04f5d7b5-cef4-4172-ba30-3d7881ab45a8 req-29136f3a-6408-4cd4-a176-b76ad509b77a tempest-TestMinimumBasicScenario-800957085 None] Deleting attachment 55da5b5b-83ba-48af-8d00-336e70ab7c40. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "cinder-1b8ed998-5971-472d-9d56-22a74c538f0a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "cinder-1b8ed998-5971-472d-9d56-22a74c538f0a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "cinder-quobyte-1b8ed998-5971-472d-9d56-22a74c538f0a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "cinder-quobyte-1b8ed998-5971-472d-9d56-22a74c538f0a" acquired by "delete_volume" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed60bd35-e1f3-4b0d-9dc7-12217133d1bb]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:33:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:18 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a Sep 08 19:33:18 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:19 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:19 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a Sep 08 19:33:19 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:19 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1b8ed998-5971-472d-9d56-22a74c538f0a" returned: 0 in 0.259s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "cinder-quobyte-1b8ed998-5971-472d-9d56-22a74c538f0a" released by "delete_volume" :: held 0.640s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Created reservations ['d4c25371-69fa-4b08-982c-9f8a1ee33cbf', 'cfe434b7-9e2f-4957-ae63-176c8e688616', '3d9dca06-014c-41e4-a274-cb883a49791f', 'efc4ed12-a219-4178-b596-4c56aaf5a830'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:19 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:33:19 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:19 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:33:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Deleted volume successfully. Sep 08 19:33:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-594cbc15-bf91-4d6f-b602-b99d406ce32b tempest-TestMinimumBasicScenario-800957085 None] Lock "cinder-1b8ed998-5971-472d-9d56-22a74c538f0a-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:33:29 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:33:29 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Flow 'volume_create_manager' (442e3379-c710-4640-96e1-a40acc0893c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a8363f-67ed-4c28-8d03-904533b2b37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a8363f-67ed-4c28-8d03-904533b2b37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-867867801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa336ba-f6b4-46ab-886c-c1f2afc8dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8aade4fb6b40d2be418449a49f4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:33:55Z,use_quota=True,user_id='4c76a0c7611e4f299d58cda4e3da9d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c22488-65cf-42fb-9b6f-596beb5831fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c22488-65cf-42fb-9b6f-596beb5831fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232e5859-f03a-4e35-84ec-e58a555c915e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:54 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232e5859-f03a-4e35-84ec-e58a555c915e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'volume_name': 'volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b46e5c7-05dd-4341-b4b5-87b8b0c8c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b46e5c7-05dd-4341-b4b5-87b8b0c8c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bb97c6-a63f-42f4-92b7-e5ec820bdd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Trying to clone efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 from image 6b778823-fa2d-480a-aa07-bfb706774474 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:33:55 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Image download 20.69 MB at 20.69 MB/s Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[055dad4c-2e56-4ab8-a05e-1931ac295759]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:55 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD Sep 08 19:33:55 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:55 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 is fetched for user 4c76a0c7611e4f299d58cda4e3da9d96. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb37fd-6eba-480a-93dc-94acb310fdb2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:33:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:55 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD Sep 08 19:33:55 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:56 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD" returned: 0 in 0.309s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-867867801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa336ba-f6b4-46ab-886c-c1f2afc8dbf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8aade4fb6b40d2be418449a49f4673',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:33:55Z,use_quota=True,user_id='4c76a0c7611e4f299d58cda4e3da9d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Creating volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:33:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:56 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1073741824 Sep 08 19:33:56 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:56 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1073741824" returned: 0 in 0.373s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:56 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 Sep 08 19:33:56 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:56 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Attempting download of 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a0a46-5959-40bb-9b32-bb5c95d8a7ab]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:33:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:57 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z Sep 08 19:33:57 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:57 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z" returned: 0 in 0.315s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:57 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z Sep 08 19:33:57 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:57 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z" returned: 1 in 0.313s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b778823-fa2d-480a-aa07-bfb706774474_0i1q3o5z' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83169f7-9744-48da-a717-bb93c95bb08c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:57 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD Sep 08 19:33:57 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:57 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] 6b778823-fa2d-480a-aa07-bfb706774474 was qcow2, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:33:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:57 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 Sep 08 19:33:57 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:59 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" returned: 0 in 1.422s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b778823-fa2d-480a-aa07-bfb706774474_qysenrjmdevstack@QuobyteHD, size 112.00 MB, duration 1.42 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:33:59 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Converted 112.00 MB image at 78.67 MB/s Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:33:59 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1G Sep 08 19:33:59 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:33:59 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 1G" returned: 0 in 0.295s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Downloaded image 6b778823-fa2d-480a-aa07-bfb706774474 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}])) to volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Temporary image 6b778823-fa2d-480a-aa07-bfb706774474 for user 4c76a0c7611e4f299d58cda4e3da9d96 is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Marking volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Copying metadata from image 6b778823-fa2d-480a-aa07-bfb706774474 to efa336ba-f6b4-46ab-886c-c1f2afc8dbf1. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Creating volume glance metadata for volume efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 backed by image 6b778823-fa2d-480a-aa07-bfb706774474 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bb97c6-a63f-42f4-92b7-e5ec820bdd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'volume_size': 1, 'image_id': '6b778823-fa2d-480a-aa07-bfb706774474', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b778823-fa2d-480a-aa07-bfb706774474', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2f338263e7fd4f079118ceb8fd971d73', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6b778823-fa2d-480a-aa07-bfb706774474', 'created_at': datetime.datetime(2026, 9, 8, 17, 9, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 9, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b778823-fa2d-480a-aa07-bfb706774474/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91adad6-7026-46b6-bb9f-e77bc51d501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:33:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Volume volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 (efa336ba-f6b4-46ab-886c-c1f2afc8dbf1): created successfully Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91adad6-7026-46b6-bb9f-e77bc51d501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:33:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Flow 'volume_create_manager' (442e3379-c710-4640-96e1-a40acc0893c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:33:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2e7fc0ca-db99-4ab0-89ec-de503865fc68 tempest-TestShelveInstance-599512851 None] Created volume successfully. Sep 08 19:34:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-70942f8e-f5d5-4465-b835-c88d3bb85a72 req-9393ba44-711c-4f1f-bdb3-f49e4ed55ffc tempest-TestShelveInstance-599512851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:34:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-70942f8e-f5d5-4465-b835-c88d3bb85a72 req-9393ba44-711c-4f1f-bdb3-f49e4ed55ffc tempest-TestShelveInstance-599512851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:34:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-70942f8e-f5d5-4465-b835-c88d3bb85a72 req-9393ba44-711c-4f1f-bdb3-f49e4ed55ffc tempest-TestShelveInstance-599512851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:34:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-70942f8e-f5d5-4465-b835-c88d3bb85a72 req-9393ba44-711c-4f1f-bdb3-f49e4ed55ffc tempest-TestShelveInstance-599512851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a17f933-2370-4a27-8580-274f899bc9d4', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:34:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-70942f8e-f5d5-4465-b835-c88d3bb85a72 req-9393ba44-711c-4f1f-bdb3-f49e4ed55ffc tempest-TestShelveInstance-599512851 None] attachment_update completed successfully. Sep 08 19:34:12 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:34:13 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=17,cinder:UPDATE=11,cinder:INSERT=9 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:34:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:34:15 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:34:15 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:34:15 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:34:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:34:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-3d90a26c-2b15-4195-a1ac-1670aaa34775 req-ddcae7ca-841e-42d9-9bb6-1a6133103737 tempest-TestShelveInstance-599512851 None] Terminate volume connection completed successfully. Sep 08 19:34:34 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-3d90a26c-2b15-4195-a1ac-1670aaa34775 req-ddcae7ca-841e-42d9-9bb6-1a6133103737 tempest-TestShelveInstance-599512851 None] Deleting attachment 6a17f933-2370-4a27-8580-274f899bc9d4. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:34:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0da3709d-bfc4-4632-8548-6740812685c8 req-bce2436f-42e6-4827-8fa5-0c9f861cfb7e tempest-TestShelveInstance-599512851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:34:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0da3709d-bfc4-4632-8548-6740812685c8 req-bce2436f-42e6-4827-8fa5-0c9f861cfb7e tempest-TestShelveInstance-599512851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:34:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0da3709d-bfc4-4632-8548-6740812685c8 req-bce2436f-42e6-4827-8fa5-0c9f861cfb7e tempest-TestShelveInstance-599512851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:34:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-0da3709d-bfc4-4632-8548-6740812685c8 req-bce2436f-42e6-4827-8fa5-0c9f861cfb7e tempest-TestShelveInstance-599512851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904', 'name': 'volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e3a7141-01f4-4727-ae87-68555779ec86', 'enforce_multipath': True} {{(pid=87521) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 08 19:34:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-0da3709d-bfc4-4632-8548-6740812685c8 req-bce2436f-42e6-4827-8fa5-0c9f861cfb7e tempest-TestShelveInstance-599512851 None] attachment_update completed successfully. Sep 08 19:34:46 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:34:46 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:15 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:15 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:15 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:35:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:35:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:35:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-b44ed452-e7f5-4463-8d75-14d42af450c8 tempest-TestShelveInstance-599512851 None] Terminate volume connection completed successfully. Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-b44ed452-e7f5-4463-8d75-14d42af450c8 tempest-TestShelveInstance-599512851 None] Deleting attachment 8e3a7141-01f4-4727-ae87-68555779ec86. {{(pid=87521) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Acquiring lock "cinder-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "cinder-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Acquiring lock "cinder-quobyte-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "cinder-quobyte-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" acquired by "delete_volume" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f01f3e-ec7a-4fec-83df-2c7a59476595]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:19 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 Sep 08 19:35:19 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:19 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:19 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1 Sep 08 19:35:19 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:19 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "cinder-quobyte-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1" released by "delete_volume" :: held 0.680s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:19 devstack cinder-volume[87521]: DEBUG cinder.quota [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Created reservations ['f0c6384d-5a05-4700-ac82-00a774bd55fa', 'a856c719-d47a-4fe3-bcde-d3ea5c4014a2', 'bc4cc659-1b6e-489e-823f-f89a2589eeca', '3d7eb94f-db3e-49c8-8214-690238427627'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:20 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:20 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:20 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG cinder.manager [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Deleted volume successfully. Sep 08 19:35:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [req-0544b952-14eb-43ef-bfac-0b81d99a3b26 req-f9222222-5bd0-4ff0-ae81-65874d8f28b0 tempest-TestShelveInstance-599512851 None] Lock "cinder-efa336ba-f6b4-46ab-886c-c1f2afc8dbf1-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:30 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:35:30 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Flow 'volume_create_manager' (50a1962d-fdba-4afc-8134-088db839ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd3079-deb3-4f9d-87d8-cabc03531764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbd3079-deb3-4f9d-87d8-cabc03531764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891721689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6118ac-d54e-4af5-9db3-86e9e7aa83c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f95ae3323e4524a06a02726ac098e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:32Z,use_quota=True,user_id='5cf042f85a4649eda0398d8ce29743d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b424d3bb-2d40-4690-ad0c-dea9c28888e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b424d3bb-2d40-4690-ad0c-dea9c28888e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04262969-632d-41f9-8377-0fa01d79447f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04262969-632d-41f9-8377-0fa01d79447f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6118ac-d54e-4af5-9db3-86e9e7aa83c2', 'volume_name': 'volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e85427e-81f5-44a0-811c-240d96a5f52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e85427e-81f5-44a0-811c-240d96a5f52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40353712-2e56-440b-95a0-74cecffd4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Volume 4a6118ac-d54e-4af5-9db3-86e9e7aa83c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2', 'volume_size': 1} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1891721689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6118ac-d54e-4af5-9db3-86e9e7aa83c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f95ae3323e4524a06a02726ac098e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:32Z,use_quota=True,user_id='5cf042f85a4649eda0398d8ce29743d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Creating volume 4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:32 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:32 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 1073741824 Sep 08 19:35:32 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:32 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 1073741824" returned: 0 in 0.414s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:32 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 Sep 08 19:35:32 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:33 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40353712-2e56-440b-95a0-74cecffd4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a55271-b602-4d1a-8949-573ddba78df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:33 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Volume volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 (4a6118ac-d54e-4af5-9db3-86e9e7aa83c2): created successfully Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a55271-b602-4d1a-8949-573ddba78df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Flow 'volume_create_manager' (50a1962d-fdba-4afc-8134-088db839ad55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d4339cab-6e82-42de-86e9-cca28555b454 tempest-ProjectReaderTests-280877412 None] Created volume successfully. Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Acquiring lock "cinder-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "cinder-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Acquiring lock "cinder-quobyte-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "cinder-quobyte-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c140edd-5fbc-4c2e-86c2-9de0e4760f7d]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:33 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 Sep 08 19:35:33 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:34 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" returned: 0 in 0.362s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:34 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2 Sep 08 19:35:34 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:34 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" returned: 0 in 0.251s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "cinder-quobyte-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2" released by "delete_volume" :: held 0.650s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Created reservations ['2de33ce0-4826-4d40-8cf3-8701eb1b1063', '7b4e6cd9-9380-4f31-854d-c1cc1f386f3a', 'ff06c18a-e302-4c5e-bd17-412d6ea143c5', 'cdc6b149-75e2-417c-b870-a51698d50680'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:34 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:34 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:34 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.232s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Deleted volume successfully. Sep 08 19:35:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e1dcb4aa-d5f9-4baa-b68d-db23fb7ff568 tempest-ProjectReaderTests-280877412 None] Lock "cinder-4a6118ac-d54e-4af5-9db3-86e9e7aa83c2-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Flow 'volume_create_manager' (c6f56ff4-c8b7-454f-9cd5-6dc079734b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74ea90e-c99b-40f1-9b92-5e0b0ec62f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f74ea90e-c99b-40f1-9b92-5e0b0ec62f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139978226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af073e26-9453-401f-b40f-e47d7c8e066b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f95ae3323e4524a06a02726ac098e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:35Z,use_quota=True,user_id='5cf042f85a4649eda0398d8ce29743d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef576c-e085-4b58-b103-aacaf4d71956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef576c-e085-4b58-b103-aacaf4d71956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07586248-2d6c-4bf1-a2f3-9bd5fbd38eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07586248-2d6c-4bf1-a2f3-9bd5fbd38eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af073e26-9453-401f-b40f-e47d7c8e066b', 'volume_name': 'volume-af073e26-9453-401f-b40f-e47d7c8e066b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df61341c-3dce-4569-8a37-0feaf29f95fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df61341c-3dce-4569-8a37-0feaf29f95fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd54399-3d68-4dac-b7c5-26845f14122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Volume af073e26-9453-401f-b40f-e47d7c8e066b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af073e26-9453-401f-b40f-e47d7c8e066b', 'volume_size': 1} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139978226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af073e26-9453-401f-b40f-e47d7c8e066b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25f95ae3323e4524a06a02726ac098e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:35Z,use_quota=True,user_id='5cf042f85a4649eda0398d8ce29743d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Creating volume af073e26-9453-401f-b40f-e47d7c8e066b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:35 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:35 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b 1073741824 Sep 08 19:35:35 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:35 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b 1073741824" returned: 0 in 0.398s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:35 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b Sep 08 19:35:35 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:35 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b" returned: 0 in 0.247s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd54399-3d68-4dac-b7c5-26845f14122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af073e26-9453-401f-b40f-e47d7c8e066b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60563cc-26cf-486b-a333-5f057309f43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:35 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Volume volume-af073e26-9453-401f-b40f-e47d7c8e066b (af073e26-9453-401f-b40f-e47d7c8e066b): created successfully Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60563cc-26cf-486b-a333-5f057309f43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:35 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Flow 'volume_create_manager' (c6f56ff4-c8b7-454f-9cd5-6dc079734b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ebf75e1c-8b14-470b-a61a-75510bcc3be6 tempest-ProjectReaderTests-280877412 None] Created volume successfully. Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Acquiring lock "cinder-af073e26-9453-401f-b40f-e47d7c8e066b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "cinder-af073e26-9453-401f-b40f-e47d7c8e066b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Acquiring lock "cinder-quobyte-af073e26-9453-401f-b40f-e47d7c8e066b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "cinder-quobyte-af073e26-9453-401f-b40f-e47d7c8e066b" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3d44a5-df2e-43ed-94b2-a04d673c3078]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:36 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b Sep 08 19:35:36 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:36 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b" returned: 0 in 0.338s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:36 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b Sep 08 19:35:36 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:36 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-af073e26-9453-401f-b40f-e47d7c8e066b" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "cinder-quobyte-af073e26-9453-401f-b40f-e47d7c8e066b" released by "delete_volume" :: held 0.626s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:36 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Created reservations ['7c4e3c9e-6741-492b-836e-5dba50f74542', '6fd2363a-41db-450c-b29a-d8417e9de2ec', '9e7c432a-1d45-41a9-b29f-6eeb8d0e7369', 'f27afce3-a98f-4c9d-85ec-c52449497ac7'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:37 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:37 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:37 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Deleted volume successfully. Sep 08 19:35:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6d3712fd-9fdc-4c42-a254-676ece93d52a tempest-ProjectReaderTests-280877412 None] Lock "cinder-af073e26-9453-401f-b40f-e47d7c8e066b-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=15,cinder:UPDATE=20,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:35:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=13,cinder:UPDATE=24,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (9ace7f7b-4dc4-4e8d-af73-ccf8c4011f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c75be71-8666-4f09-8331-1d6430613a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c75be71-8666-4f09-8331-1d6430613a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209168748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1453fb8-c520-40ac-ad34-783bff903dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:49Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f254fab-3133-4042-b729-7d3fed68c3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f254fab-3133-4042-b729-7d3fed68c3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b3dc0-8e71-4083-b636-2e3e18e3a537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152b3dc0-8e71-4083-b636-2e3e18e3a537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1453fb8-c520-40ac-ad34-783bff903dd7', 'volume_name': 'volume-e1453fb8-c520-40ac-ad34-783bff903dd7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74107374-7c78-4f49-b113-165bd329a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74107374-7c78-4f49-b113-165bd329a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a636e82-1b7d-4518-91f3-1fd1c4610bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume e1453fb8-c520-40ac-ad34-783bff903dd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1453fb8-c520-40ac-ad34-783bff903dd7', 'volume_size': 1} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1209168748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1453fb8-c520-40ac-ad34-783bff903dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:49Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume e1453fb8-c520-40ac-ad34-783bff903dd7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:49 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:49 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 1073741824 Sep 08 19:35:49 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (eaa4a5ad-8bf9-46a5-83ab-02f2faa95116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27612f6-84ba-4cd1-b6d9-25b42da98db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27612f6-84ba-4cd1-b6d9-25b42da98db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139584606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172c3c0b-8643-4dfe-a1d0-340f109fad90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:49Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78635af1-8932-4158-8eb2-f76e461ae4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78635af1-8932-4158-8eb2-f76e461ae4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1043d051-ce4d-4bc0-9867-30fbbda6a616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1043d051-ce4d-4bc0-9867-30fbbda6a616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '172c3c0b-8643-4dfe-a1d0-340f109fad90', 'volume_name': 'volume-172c3c0b-8643-4dfe-a1d0-340f109fad90', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1d874-d5a1-4a0e-8701-2571af1c6329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b1d874-d5a1-4a0e-8701-2571af1c6329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3043cf5d-663b-4ad9-b099-9ae01d0b6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume 172c3c0b-8643-4dfe-a1d0-340f109fad90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-172c3c0b-8643-4dfe-a1d0-340f109fad90', 'volume_size': 1} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (50cc769d-d222-4263-bae5-aa103ac41a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b5304f-8da1-4d4f-b6f9-bab0f5371626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b5304f-8da1-4d4f-b6f9-bab0f5371626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768785050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f433b-2336-4f7e-81f4-a7cef8cfdd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:50Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18c6bca-7d1b-4ad1-9b3d-fcbd30663824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e18c6bca-7d1b-4ad1-9b3d-fcbd30663824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d004ad-0457-4f19-b61e-0fb8620e307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d004ad-0457-4f19-b61e-0fb8620e307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0f433b-2336-4f7e-81f4-a7cef8cfdd63', 'volume_name': 'volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6450a9c-871b-49c6-bb05-b5e790a81f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6450a9c-871b-49c6-bb05-b5e790a81f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c341b998-1432-484d-b306-eb5fcca4d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Volume ea0f433b-2336-4f7e-81f4-a7cef8cfdd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63', 'volume_size': 1} Sep 08 19:35:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:50 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 1073741824" returned: 0 in 0.576s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:50 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 Sep 08 19:35:50 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (926bf1f7-ed3b-4e6d-ab29-058f1158fbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f39f7c-b515-4df6-a729-3a543149866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f39f7c-b515-4df6-a729-3a543149866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828669799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41115fb6-5bfa-4e06-9861-c50e26d4edb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:50Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc229da1-77a1-41c2-99f8-15157a2df3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc229da1-77a1-41c2-99f8-15157a2df3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ccf6fa-504f-45f4-9a87-948b7463e707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ccf6fa-504f-45f4-9a87-948b7463e707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41115fb6-5bfa-4e06-9861-c50e26d4edb3', 'volume_name': 'volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d26b9-663e-4006-a0e4-f3c73de2376a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff4d26b9-663e-4006-a0e4-f3c73de2376a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2f6e8e-8771-4648-9c5b-160778fd45ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Volume 41115fb6-5bfa-4e06-9861-c50e26d4edb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3', 'volume_size': 1} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7" returned: 0 in 0.402s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1139584606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172c3c0b-8643-4dfe-a1d0-340f109fad90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:49Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume 172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:50 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a636e82-1b7d-4518-91f3-1fd1c4610bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1453fb8-c520-40ac-ad34-783bff903dd7', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da60f10-1405-4a9a-b93b-a1bab42d9e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 1073741824 Sep 08 19:35:50 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-e1453fb8-c520-40ac-ad34-783bff903dd7 (e1453fb8-c520-40ac-ad34-783bff903dd7): created successfully Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da60f10-1405-4a9a-b93b-a1bab42d9e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (9ace7f7b-4dc4-4e8d-af73-ccf8c4011f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-946f9f76-e323-4ac9-8bc1-da26ef7ea544 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (44d04d9b-7a28-4cd9-bba7-360b7870d0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81cf2ba-8add-47de-8318-ec084799bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81cf2ba-8add-47de-8318-ec084799bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107949482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b026cfd-2593-437f-ac88-b616701d6da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:51Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a5f6ab-0a8f-4410-a669-bc6504921f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a5f6ab-0a8f-4410-a669-bc6504921f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa530215-bb76-40b5-acd1-6f2b533ba074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa530215-bb76-40b5-acd1-6f2b533ba074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b026cfd-2593-437f-ac88-b616701d6da6', 'volume_name': 'volume-8b026cfd-2593-437f-ac88-b616701d6da6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d201f40-5a5d-4575-bfff-730d62d70da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d201f40-5a5d-4575-bfff-730d62d70da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73b4466-f553-4514-987b-d12c43d94bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Volume 8b026cfd-2593-437f-ac88-b616701d6da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b026cfd-2593-437f-ac88-b616701d6da6', 'volume_size': 1} Sep 08 19:35:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:51 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 1073741824" returned: 0 in 0.576s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:51 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 Sep 08 19:35:51 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (d2b10a14-5a16-46e8-b4e4-38351e0d04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691953b-ac88-4fda-99df-a3256216b841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3691953b-ac88-4fda-99df-a3256216b841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687030627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ba6c95-5fb8-4948-8393-3a9148c689ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:51Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed18450-7498-48cc-82d8-78e657d9f7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed18450-7498-48cc-82d8-78e657d9f7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de1d037-6c90-45ef-a13d-a18bd96a8586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de1d037-6c90-45ef-a13d-a18bd96a8586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93ba6c95-5fb8-4948-8393-3a9148c689ed', 'volume_name': 'volume-93ba6c95-5fb8-4948-8393-3a9148c689ed', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a48375a-1d60-4dba-8df3-9822e9317e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a48375a-1d60-4dba-8df3-9822e9317e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57e355d-d6ff-47ec-a4e0-fe923c4ff9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Volume 93ba6c95-5fb8-4948-8393-3a9148c689ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93ba6c95-5fb8-4948-8393-3a9148c689ed', 'volume_size': 1} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:51 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-768785050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea0f433b-2336-4f7e-81f4-a7cef8cfdd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:50Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Creating volume ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3043cf5d-663b-4ad9-b099-9ae01d0b6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172c3c0b-8643-4dfe-a1d0-340f109fad90', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d8f251-614c-47ae-88d4-de8372e47653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 1073741824 Sep 08 19:35:51 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 (172c3c0b-8643-4dfe-a1d0-340f109fad90): created successfully Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d8f251-614c-47ae-88d4-de8372e47653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (eaa4a5ad-8bf9-46a5-83ab-02f2faa95116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5eb96afa-9b43-4de5-897d-d93086aa470e tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (1a2677a3-5c16-435d-80a9-b111593167b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d19317-6f01-4fe6-85c9-8abb8febd2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d19317-6f01-4fe6-85c9-8abb8febd2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059612626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2a24ff-e024-444e-a828-4ad870efbaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2a24ff-e024-444e-a828-4ad870efbaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622410d9-5a49-4863-9bf3-b832cd6f0bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622410d9-5a49-4863-9bf3-b832cd6f0bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e', 'volume_name': 'volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0accf6c1-c7a6-4659-8382-9f3c59657710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0accf6c1-c7a6-4659-8382-9f3c59657710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ee7e2b-b84f-4334-aa0d-d17461457f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Volume 80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e', 'volume_size': 1} Sep 08 19:35:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:52 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 1073741824" returned: 0 in 0.564s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (9d9db758-4419-469b-8336-c1f69b65e79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3923a1-e15d-47b8-bd38-353b9045234d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b3923a1-e15d-47b8-bd38-353b9045234d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538336945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7433136-efe3-4690-a73c-2a235e98c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 Sep 08 19:35:52 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23a443e-b7f9-462d-bd21-98930a6e2536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23a443e-b7f9-462d-bd21-98930a6e2536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14030ca4-7c6f-444f-bec7-4c83e3a37b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14030ca4-7c6f-444f-bec7-4c83e3a37b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7433136-efe3-4690-a73c-2a235e98c78e', 'volume_name': 'volume-a7433136-efe3-4690-a73c-2a235e98c78e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0594288-bad0-4121-b9d5-df5001e25913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0594288-bad0-4121-b9d5-df5001e25913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9686031-9337-4194-8c39-d2b65c1f345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume a7433136-efe3-4690-a73c-2a235e98c78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7433136-efe3-4690-a73c-2a235e98c78e', 'volume_size': 1} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:52 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (bb39d0c8-b521-474e-837f-0a16fe89f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c26608a-6938-43d9-b884-4609ebf69657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" returned: 0 in 0.448s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.113s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1828669799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41115fb6-5bfa-4e06-9861-c50e26d4edb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:50Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Creating volume 41115fb6-5bfa-4e06-9861-c50e26d4edb3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:52 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c26608a-6938-43d9-b884-4609ebf69657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646087050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 1073741824 Sep 08 19:35:52 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f6e2e1-6779-4e05-9146-82e01f7916f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f6e2e1-6779-4e05-9146-82e01f7916f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e257fea5-9470-4e42-9ff5-3289b25836e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e257fea5-9470-4e42-9ff5-3289b25836e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0', 'volume_name': 'volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd98285-59ad-4403-854c-7c00197a1846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd98285-59ad-4403-854c-7c00197a1846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2529b44-039e-49e3-84a1-c4a7d028155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume 6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0', 'volume_size': 1} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c341b998-1432-484d-b306-eb5fcca4d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050b744d-ef8c-4b21-ba6e-5b24620a2686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Volume volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 (ea0f433b-2336-4f7e-81f4-a7cef8cfdd63): created successfully Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050b744d-ef8c-4b21-ba6e-5b24620a2686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (50cc769d-d222-4263-bae5-aa103ac41a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cc2e3083-9819-4ee4-97b4-de50ce8e106e tempest-CreateVolumesFromImageTest-1673925436 None] Created volume successfully. Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:53 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (30929a44-ea17-4e93-8967-307ead155068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c10c83-0a8b-48eb-bcf4-6a33c7be701a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 1073741824" returned: 0 in 0.747s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c10c83-0a8b-48eb-bcf4-6a33c7be701a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933828930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7b519b-30d4-476c-a781-26e4e17671da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:53Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a1bbbd-a4da-4ea8-9a9c-d7ca7b0dd8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a1bbbd-a4da-4ea8-9a9c-d7ca7b0dd8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0941233-dcfd-48b8-b4ce-4d0d1440c1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0941233-dcfd-48b8-b4ce-4d0d1440c1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7b519b-30d4-476c-a781-26e4e17671da', 'volume_name': 'volume-6b7b519b-30d4-476c-a781-26e4e17671da', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63946cc3-28fe-4314-8a1f-1ed8b5b0558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63946cc3-28fe-4314-8a1f-1ed8b5b0558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fe4dd6-0e41-4648-ae71-f0de397ff337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume 6b7b519b-30d4-476c-a781-26e4e17671da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7b519b-30d4-476c-a781-26e4e17671da', 'volume_size': 1} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:53 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 Sep 08 19:35:53 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (148e1951-2392-493a-849c-42bfb3c7216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8855acb2-4f41-40ff-bbd3-5481c0ccbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8855acb2-4f41-40ff-bbd3-5481c0ccbb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-30821974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c616d3c4-fed7-4146-99db-4a3e2e75acf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2641446-0d0e-4034-be98-18a28c2d6702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2641446-0d0e-4034-be98-18a28c2d6702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d56a3f-1568-45ad-8d03-2ad989b9c953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d56a3f-1568-45ad-8d03-2ad989b9c953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c616d3c4-fed7-4146-99db-4a3e2e75acf5', 'volume_name': 'volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25101c5b-51bf-44d6-b101-b04183cc8713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25101c5b-51bf-44d6-b101-b04183cc8713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d81dcb-7028-4a46-973b-5742e267ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume c616d3c4-fed7-4146-99db-4a3e2e75acf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5', 'volume_size': 1} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:53 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.810s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2107949482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b026cfd-2593-437f-ac88-b616701d6da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:51Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Creating volume 8b026cfd-2593-437f-ac88-b616701d6da6 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:53 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2f6e8e-8771-4648-9c5b-160778fd45ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275b226b-24aa-493e-95ec-fdf668f5668d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:53 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 1073741824 Sep 08 19:35:53 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:53 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Volume volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 (41115fb6-5bfa-4e06-9861-c50e26d4edb3): created successfully Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (275b226b-24aa-493e-95ec-fdf668f5668d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (926bf1f7-ed3b-4e6d-ab29-058f1158fbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:53 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-23864b1b-04f4-4c60-856c-aa2c2fb5dd77 tempest-CreateVolumesFromImageTest-1673925436 None] Created volume successfully. Sep 08 19:35:53 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (998132ab-7edd-49bb-a9f9-776a4c48833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282c410d-8171-4e20-8d19-3c9781d85981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282c410d-8171-4e20-8d19-3c9781d85981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157873780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b484b599-50fd-4b2e-bb05-e3dd7182d853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d86ee33-5bd3-4a2a-9c34-6469c5ad992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d86ee33-5bd3-4a2a-9c34-6469c5ad992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93aa644-8725-4f1d-848a-0dfc42abf5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93aa644-8725-4f1d-848a-0dfc42abf5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b484b599-50fd-4b2e-bb05-e3dd7182d853', 'volume_name': 'volume-b484b599-50fd-4b2e-bb05-e3dd7182d853', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8767c-aacc-4634-aff8-4aac0443b79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd8767c-aacc-4634-aff8-4aac0443b79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b95bc-3d0a-4721-81a8-cade62f4e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume b484b599-50fd-4b2e-bb05-e3dd7182d853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b484b599-50fd-4b2e-bb05-e3dd7182d853', 'volume_size': 1} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Flow 'volume_create_manager' (eb955811-0198-4958-afde-129510abf51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427c671b-7e61-4aab-8ab7-4f67829e3c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427c671b-7e61-4aab-8ab7-4f67829e3c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa24b448-b42f-433d-a433-2984fddf6fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b5dd25881478f8c5652911fcc4d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='2eedc12d2de8402094c98d26a8779474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5986917a-6f24-44b3-845c-123197693759),volume_type_id=5986917a-6f24-44b3-845c-123197693759)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096ae7a-fd75-4e21-ac28-a46d196ea79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096ae7a-fd75-4e21-ac28-a46d196ea79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7a0437-e881-4663-861a-5a55715d217c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 1073741824" returned: 0 in 0.575s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:54 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 Sep 08 19:35:54 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b7a0437-e881-4663-861a-5a55715d217c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa24b448-b42f-433d-a433-2984fddf6fd7', 'volume_name': 'volume-aa24b448-b42f-433d-a433-2984fddf6fd7', 'volume_size': 1, 'image_id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '872dbe962534bb0037c16e00c00e0fdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '929b5dd25881478f8c5652911fcc4d77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c073a56c4df3ce223143d057e140a256aba69a3076b40a67a43fed858a7403a2d36a629fc59abb476709e0486ce5dd9d150409ddf3259ae9ec0e7480280adfcf', 'id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'created_at': datetime.datetime(2026, 9, 8, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 35, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9de9f57f-c080-4552-973d-18499aaa06fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bcf8e8-9ad7-41e1-8d73-3a9c5f160bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5bcf8e8-9ad7-41e1-8d73-3a9c5f160bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714d0df7-0af9-4a41-a087-0ded44c298c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Volume aa24b448-b42f-433d-a433-2984fddf6fd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa24b448-b42f-433d-a433-2984fddf6fd7', 'volume_size': 1, 'image_id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '872dbe962534bb0037c16e00c00e0fdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '929b5dd25881478f8c5652911fcc4d77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c073a56c4df3ce223143d057e140a256aba69a3076b40a67a43fed858a7403a2d36a629fc59abb476709e0486ce5dd9d150409ddf3259ae9ec0e7480280adfcf', 'id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'created_at': datetime.datetime(2026, 9, 8, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 35, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9de9f57f-c080-4552-973d-18499aaa06fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Trying to clone aa24b448-b42f-433d-a433-2984fddf6fd7 from image 9de9f57f-c080-4552-973d-18499aaa06fe at location (None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:35:54 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6" returned: 0 in 0.268s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.288s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1687030627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93ba6c95-5fb8-4948-8393-3a9148c689ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:51Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Creating volume 93ba6c95-5fb8-4948-8393-3a9148c689ed {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:54 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed 1073741824 Sep 08 19:35:54 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d73b4466-f553-4514-987b-d12c43d94bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b026cfd-2593-437f-ac88-b616701d6da6', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62984921-e49a-42c9-91ed-0d04a3f78835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Volume volume-8b026cfd-2593-437f-ac88-b616701d6da6 (8b026cfd-2593-437f-ac88-b616701d6da6): created successfully Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62984921-e49a-42c9-91ed-0d04a3f78835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (44d04d9b-7a28-4cd9-bba7-360b7870d0f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ec3dc974-8d41-44ba-91f6-113c48371041 tempest-CreateVolumesFromImageTest-1673925436 None] Created volume successfully. Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:35:54 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[59258da8-514d-4dff-8bf9-33e36add0c7d]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:54 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:35:54 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed 1073741824" returned: 0 in 0.447s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:55 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:55 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed Sep 08 19:35:55 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:35:55 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059612626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='264002382f7a4beda10a27dde16d3293',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='c38f80f8a82c4a638042d6281e818098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Creating volume 80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:55 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57e355d-d6ff-47ec-a4e0-fe923c4ff9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93ba6c95-5fb8-4948-8393-3a9148c689ed', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811d38ea-b964-4679-9d90-d29a22f6e11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:55 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e 1073741824 Sep 08 19:35:55 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Volume volume-93ba6c95-5fb8-4948-8393-3a9148c689ed (93ba6c95-5fb8-4948-8393-3a9148c689ed): created successfully Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811d38ea-b964-4679-9d90-d29a22f6e11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (d2b10a14-5a16-46e8-b4e4-38351e0d04bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e74b915f-7153-4d45-8fb2-44b1fe24cfdc tempest-CreateVolumesFromImageTest-1673925436 None] Created volume successfully. Sep 08 19:35:55 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 1 in 0.370s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Temporary image 9de9f57f-c080-4552-973d-18499aaa06fe is fetched for user 2eedc12d2de8402094c98d26a8779474. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6573efa-a925-4368-8f2c-49feabeedaa7]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:55 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:35:55 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e 1073741824" returned: 0 in 0.418s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:55 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e Sep 08 19:35:55 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:55 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:35:56 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:56 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.905s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-538336945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7433136-efe3-4690-a73c-2a235e98c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume a7433136-efe3-4690-a73c-2a235e98c78e {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ee7e2b-b84f-4334-aa0d-d17461457f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:56 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e 1073741824 Sep 08 19:35:56 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312cc508-c5ae-4fca-9a41-48150448caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Volume volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e (80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e): created successfully Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312cc508-c5ae-4fca-9a41-48150448caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Flow 'volume_create_manager' (1a2677a3-5c16-435d-80a9-b111593167b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-27fa18bf-3210-4e47-9d69-913677448ce4 tempest-CreateVolumesFromImageTest-1673925436 None] Created volume successfully. Sep 08 19:35:56 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-quobyte-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" acquired by "delete_volume" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c050c939-0d71-4c2b-96da-309507497ddc]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e 1073741824" returned: 0 in 0.478s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e Sep 08 19:35:56 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:56 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e Sep 08 19:35:56 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:56 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e" returned: 0 in 0.249s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-646087050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:52Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume 6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9686031-9337-4194-8c39-d2b65c1f345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7433136-efe3-4690-a73c-2a235e98c78e', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b0b558-14bc-48fc-8237-4a4655678396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:56 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 1073741824 Sep 08 19:35:56 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-a7433136-efe3-4690-a73c-2a235e98c78e (a7433136-efe3-4690-a73c-2a235e98c78e): created successfully Sep 08 19:35:56 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97b0b558-14bc-48fc-8237-4a4655678396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (9d9db758-4419-469b-8336-c1f69b65e79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" returned: 0 in 0.376s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-98e4e4ed-4211-4251-82cc-7b2b9368d89e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:35:56 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e Sep 08 19:35:56 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:57 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" returned: 0 in 0.264s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e" released by "delete_volume" :: held 0.678s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Created reservations ['74d4ddb4-bdec-4eb3-8686-2a6f55978f5a', '2cc20d05-59e7-413f-a572-439810496bdf', '4ccf88a1-35de-4f07-9cc0-3ca023a092d5', 'fcb2dc56-ca05-4130-8ede-bdb346a911ef'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:57 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 1073741824" returned: 0 in 0.480s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:57 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:57 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:57 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 Sep 08 19:35:57 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:57 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.248s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Deleted volume successfully. Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0798fc39-be0e-4408-ab92-958827882854 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-80ce0868-5d1e-41c7-8d65-b0ed08d9ea2e-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-93ba6c95-5fb8-4948-8393-3a9148c689ed-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-93ba6c95-5fb8-4948-8393-3a9148c689ed-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:57 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" returned: 0 in 0.275s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.429s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2529b44-039e-49e3-84a1-c4a7d028155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81d3ab9-ab4c-4d62-821c-2d1996792571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating offline snapshot d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 of volume 172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:35:57 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 (6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0): created successfully Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81d3ab9-ab4c-4d62-821c-2d1996792571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (bb39d0c8-b521-474e-837f-0a16fe89f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-quobyte-93ba6c95-5fb8-4948-8393-3a9148c689ed" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff500ad-0483-4472-b153-d14e224e6e18]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-67316d03-0ff6-4d70-9e5e-10a07ae1adc1 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-93ba6c95-5fb8-4948-8393-3a9148c689ed" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[929221a9-dcf0-4454-86e1-94487c371982]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:57 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 Sep 08 19:35:57 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:57 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed Sep 08 19:35:57 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:58 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 1G Sep 08 19:35:58 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:58 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed" returned: 0 in 0.392s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed Sep 08 19:35:58 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:58 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-93ba6c95-5fb8-4948-8393-3a9148c689ed" returned: 0 in 0.249s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-93ba6c95-5fb8-4948-8393-3a9148c689ed" released by "delete_volume" :: held 0.685s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Created reservations ['4f55adce-d48f-4d85-adc4-f3354feb5302', 'e6921ea8-76b1-4cab-98d5-269284455606', '997fd259-4924-4e3b-a247-6b8529c0cec8', '0375d0a4-a575-4a5a-bf01-ff8e535bc04c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:58 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 1G" returned: 0 in 0.467s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:58 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 Sep 08 19:35:58 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:58 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-8b026cfd-2593-437f-ac88-b616701d6da6-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-8b026cfd-2593-437f-ac88-b616701d6da6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-quobyte-8b026cfd-2593-437f-ac88-b616701d6da6" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-8b026cfd-2593-437f-ac88-b616701d6da6" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d16012-7b4b-4a12-bb78-a697e435bf7e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.299s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:58 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:58 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 is being set with open permissions: ugo+rw Sep 08 19:35:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Deleted volume successfully. Sep 08 19:35:59 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 Sep 08 19:35:59 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d2175102-bb72-47cd-8050-5f1b37641345 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-93ba6c95-5fb8-4948-8393-3a9148c689ed-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:59 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 Sep 08 19:35:59 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:59 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info Sep 08 19:35:59 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:59 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6 Sep 08 19:35:59 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info is being set with open permissions: ugo+rw Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:59 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info Sep 08 19:35:59 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-8b026cfd-2593-437f-ac88-b616701d6da6" returned: 0 in 0.263s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-8b026cfd-2593-437f-ac88-b616701d6da6" released by "delete_volume" :: held 0.692s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Created reservations ['fb552658-568f-4bed-86c8-4b84dfd3d898', '34455dbd-67c3-4cfe-ab0c-6a6ef9fa5dc7', 'e4017dc2-34b1-44d7-a0d4-235338e490cd', 'cb22d1f4-dc95-4920-9d4c-a7820c28c7f2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:59 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:35:59 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.info" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.107s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.413s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933828930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7b519b-30d4-476c-a781-26e4e17671da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:53Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume 6b7b519b-30d4-476c-a781-26e4e17671da {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:35:59 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:35:59 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da 1073741824 Sep 08 19:35:59 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:35:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-99793329-e4c6-4fcd-b77b-a9f81f486ebe tempest-CreateVolumesFromSnapshotTest-1704952012 None] Create snapshot completed successfully Sep 08 19:35:59 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.264s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:35:59 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:35:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Deleted volume successfully. Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-41115fb6-5bfa-4e06-9861-c50e26d4edb3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1fb0ffcf-d91a-4f63-9de7-bd578c8a00e5 tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-8b026cfd-2593-437f-ac88-b616701d6da6-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-41115fb6-5bfa-4e06-9861-c50e26d4edb3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-quobyte-41115fb6-5bfa-4e06-9861-c50e26d4edb3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-41115fb6-5bfa-4e06-9861-c50e26d4edb3" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1999eee8-77cb-48aa-8f82-226d6cc399b6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:00 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 Sep 08 19:36:00 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:00 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da 1073741824" returned: 0 in 0.499s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:00 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da Sep 08 19:36:00 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:00 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3" returned: 0 in 0.449s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:00 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3 Sep 08 19:36:00 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:00 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.993s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-30821974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c616d3c4-fed7-4146-99db-4a3e2e75acf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume c616d3c4-fed7-4146-99db-4a3e2e75acf5 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:00 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fe4dd6-0e41-4648-ae71-f0de397ff337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7b519b-30d4-476c-a781-26e4e17671da', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 1073741824 Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b2b9e-1823-4281-9705-6ac3292bd13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-6b7b519b-30d4-476c-a781-26e4e17671da (6b7b519b-30d4-476c-a781-26e4e17671da): created successfully Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (189b2b9e-1823-4281-9705-6ac3292bd13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (30929a44-ea17-4e93-8967-307ead155068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9f3ec0ee-8921-467d-9dbf-8b4ea0c142a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (bf6d943a-c896-4afb-bc91-bd08cb10c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0debb752-6850-45a9-a166-74794bf7b23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0debb752-6850-45a9-a166-74794bf7b23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46352020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11322045-d790-4040-b87d-7fa07e72526c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:01Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3c5264-9f20-40f7-aa4f-0dd45323bac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3c5264-9f20-40f7-aa4f-0dd45323bac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f306302-353d-4a78-8540-280f1f0c723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f306302-353d-4a78-8540-280f1f0c723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11322045-d790-4040-b87d-7fa07e72526c', 'volume_name': 'volume-11322045-d790-4040-b87d-7fa07e72526c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad579d8-556a-472a-95ad-bf93b76d1290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ad579d8-556a-472a-95ad-bf93b76d1290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284ff302-0321-4ebe-a5de-a558a99fe8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume 11322045-d790-4040-b87d-7fa07e72526c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11322045-d790-4040-b87d-7fa07e72526c', 'volume_size': 1} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-41115fb6-5bfa-4e06-9861-c50e26d4edb3" returned: 0 in 0.328s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-41115fb6-5bfa-4e06-9861-c50e26d4edb3" released by "delete_volume" :: held 0.819s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:00 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Created reservations ['c9b9106d-fcb3-4042-b585-1bdbce828199', '4538d53c-6a66-4dac-8b66-ea47907261e3', '5b2a16c9-ff19-470c-9af6-acef2e2bee20', '7b6ba6bc-0ca7-4f72-aff5-5d7d9634d5f0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:01 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:01 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (e31b779d-1ba0-4948-add8-772952d8258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d4a646-bf35-4326-bcc6-94e4a698f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d4a646-bf35-4326-bcc6-94e4a698f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783306460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c812ddba-6426-464d-8139-d47ef0f934c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:01Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c5965e-3dab-476b-85a4-560920db4aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07c5965e-3dab-476b-85a4-560920db4aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5902823a-2756-4f85-a178-fe6a89501522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5902823a-2756-4f85-a178-fe6a89501522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c812ddba-6426-464d-8139-d47ef0f934c8', 'volume_name': 'volume-c812ddba-6426-464d-8139-d47ef0f934c8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f0982b-4299-4fb7-a268-b64214d4219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f0982b-4299-4fb7-a268-b64214d4219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dae2cb-6cd5-45b0-bd4f-7ad889eca13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume c812ddba-6426-464d-8139-d47ef0f934c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c812ddba-6426-464d-8139-d47ef0f934c8', 'volume_size': 1} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "cinder-quobyte-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:01 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 1073741824" returned: 0 in 0.712s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" acquired by "delete_volume" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df00156-6982-4d5e-92bc-220e0c2b3b58]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:01 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.418s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:01 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 Sep 08 19:36:01 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Deleted volume successfully. Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cae1a4d4-e8db-480c-8e04-cc77c77d2e3f tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-41115fb6-5bfa-4e06-9861-c50e26d4edb3-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:01 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 Sep 08 19:36:01 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (4028e2b5-6cd1-484f-b67e-385a6cb718a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929f74c8-0c4f-477e-9a8a-2e4967e4d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929f74c8-0c4f-477e-9a8a-2e4967e4d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108377578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d43eccb-5074-4829-ae4f-6ace7406fa87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6664aeb-7cc7-49cf-8097-c7538f4455df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6664aeb-7cc7-49cf-8097-c7538f4455df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc96a8b-6c19-4dfe-9542-5a9fe881bbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc96a8b-6c19-4dfe-9542-5a9fe881bbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d43eccb-5074-4829-ae4f-6ace7406fa87', 'volume_name': 'volume-5d43eccb-5074-4829-ae4f-6ace7406fa87', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414e5d0-ee56-4585-aa7f-5a5d1b871883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414e5d0-ee56-4585-aa7f-5a5d1b871883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a399cc85-2648-4d97-9d62-c501b16ebff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:01 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume 5d43eccb-5074-4829-ae4f-6ace7406fa87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d43eccb-5074-4829-ae4f-6ace7406fa87', 'volume_size': 1} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:01 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5" returned: 0 in 0.474s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.843s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1157873780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b484b599-50fd-4b2e-bb05-e3dd7182d853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4488a63c8e4d7cbe6cf112e139bbdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='bd1ababf4b1c4ab98078666dee865348',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Creating volume b484b599-50fd-4b2e-bb05-e3dd7182d853 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:01 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:01 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" returned: 0 in 0.489s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:01 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 1073741824 Sep 08 19:36:01 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64d81dcb-7028-4a46-973b-5742e267ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51820779-0555-4ea8-b5f0-1561bbdd84b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63 Sep 08 19:36:02 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 (c616d3c4-fed7-4146-99db-4a3e2e75acf5): created successfully Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51820779-0555-4ea8-b5f0-1561bbdd84b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (148e1951-2392-493a-849c-42bfb3c7216b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7ee6f087-bd78-42db-afd2-d627666c3999 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (06157728-5af8-4131-947d-a5b41be0e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d8f524-f4e5-4eca-915d-f92577ef61ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d8f524-f4e5-4eca-915d-f92577ef61ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66703405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a3cb38-dd75-404c-a67b-2e4dd2eb36ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d191efa4-c1b4-4ffa-bc17-90da86908c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d191efa4-c1b4-4ffa-bc17-90da86908c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e97e0a8-0101-4e67-aaa7-a87a60d8741c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e97e0a8-0101-4e67-aaa7-a87a60d8741c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11a3cb38-dd75-404c-a67b-2e4dd2eb36ac', 'volume_name': 'volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbbbf2e-9e0b-4e71-8f53-5a6a5e608b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbbbf2e-9e0b-4e71-8f53-5a6a5e608b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656f1c19-185a-443e-9009-3f86777ed6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume 11a3cb38-dd75-404c-a67b-2e4dd2eb36ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac', 'volume_size': 1} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:02 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-quobyte-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63" released by "delete_volume" :: held 0.915s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Created reservations ['511ffe3a-93b0-4889-be07-ae5daa850236', '04af6e8f-a5b7-483d-a549-ea40d8dbce4e', '1c1632f2-7436-4e82-bd96-4b0dbddcd80b', 'eaa98416-900e-49ee-ac1d-7cf4f9cac03e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:02 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:02 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (789d39a3-d768-462c-b3cd-211b579920d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae229593-d42e-4dfb-b1cd-bfc12529bb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 1073741824" returned: 0 in 0.633s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae229593-d42e-4dfb-b1cd-bfc12529bb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301547576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c6c50-2688-44bc-9fef-d3eeecd71572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e4e31-9bb3-4ea1-a68a-dc34503343ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6e4e31-9bb3-4ea1-a68a-dc34503343ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb531035-89ab-4a50-8f46-89f91e5b90bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb531035-89ab-4a50-8f46-89f91e5b90bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8c6c50-2688-44bc-9fef-d3eeecd71572', 'volume_name': 'volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af820843-4707-44eb-a005-a974387458e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af820843-4707-44eb-a005-a974387458e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6972e8fc-0661-4484-bf82-1a4cf610f51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume 1c8c6c50-2688-44bc-9fef-d3eeecd71572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572', 'volume_size': 1} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:02 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 Sep 08 19:36:02 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:02 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.278s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Deleted volume successfully. Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3f048ec8-6c2d-4cb6-ad50-251fba10618b tempest-CreateVolumesFromImageTest-1673925436 None] Lock "cinder-ea0f433b-2336-4f7e-81f4-a7cef8cfdd63-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:02 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853" returned: 0 in 0.263s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.671s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa24b448-b42f-433d-a433-2984fddf6fd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='929b5dd25881478f8c5652911fcc4d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:35:54Z,use_quota=True,user_id='2eedc12d2de8402094c98d26a8779474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5986917a-6f24-44b3-845c-123197693759),volume_type_id=5986917a-6f24-44b3-845c-123197693759)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Creating volume aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421b95bc-3d0a-4721-81a8-cade62f4e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b484b599-50fd-4b2e-bb05-e3dd7182d853', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1073741824 Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61861c49-e218-4c2a-8452-b245b5873efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:02 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Volume volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 (b484b599-50fd-4b2e-bb05-e3dd7182d853): created successfully Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61861c49-e218-4c2a-8452-b245b5873efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:02 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Flow 'volume_create_manager' (998132ab-7edd-49bb-a9f9-776a4c48833e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-051f3506-ed2f-483a-abf6-7a30c1f62b63 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created volume successfully. Sep 08 19:36:03 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1073741824" returned: 0 in 0.404s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:03 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 Sep 08 19:36:03 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:03 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7" returned: 0 in 0.282s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.741s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-46352020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11322045-d790-4040-b87d-7fa07e72526c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:01Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume 11322045-d790-4040-b87d-7fa07e72526c {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:03 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:03 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c 1073741824 Sep 08 19:36:03 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Attempting download of 9de9f57f-c080-4552-973d-18499aaa06fe ((None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}])) to volume aa24b448-b42f-433d-a433-2984fddf6fd7. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c675501d-76a6-4b42-a392-1eee68cb42e8]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:03 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1 Sep 08 19:36:03 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-b484b599-50fd-4b2e-bb05-e3dd7182d853-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-b484b599-50fd-4b2e-bb05-e3dd7182d853-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-b484b599-50fd-4b2e-bb05-e3dd7182d853" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-b484b599-50fd-4b2e-bb05-e3dd7182d853" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c512e3-b815-4cf8-b522-b9d3c8ec5da7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 Sep 08 19:36:04 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c 1073741824" returned: 0 in 0.583s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1" returned: 0 in 0.485s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c Sep 08 19:36:04 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1 Sep 08 19:36:04 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853" returned: 0 in 0.453s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853 Sep 08 19:36:04 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.341s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783306460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c812ddba-6426-464d-8139-d47ef0f934c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:01Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume c812ddba-6426-464d-8139-d47ef0f934c8 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:04 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 1073741824 Sep 08 19:36:04 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284ff302-0321-4ebe-a5de-a558a99fe8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11322045-d790-4040-b87d-7fa07e72526c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f37005-32a5-4c58-b667-ffa0996794cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1" returned: 1 in 0.489s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9de9f57f-c080-4552-973d-18499aaa06fe_2fy5y3i1' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde617ae-62c5-4050-a811-2ae8bb3e993c]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:04 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-11322045-d790-4040-b87d-7fa07e72526c (11322045-d790-4040-b87d-7fa07e72526c): created successfully Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f37005-32a5-4c58-b667-ffa0996794cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (bf6d943a-c896-4afb-bc91-bd08cb10c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-831fc569-2bea-416b-b3a6-771ae813e656 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:36:04 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b484b599-50fd-4b2e-bb05-e3dd7182d853" returned: 0 in 0.319s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-b484b599-50fd-4b2e-bb05-e3dd7182d853" released by "delete_volume" :: held 0.836s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:04 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:36:04 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:04 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['18c35714-dac4-4bf2-b745-9d2939157270', '14c2c65a-0637-489d-8d76-84bebe8acde4', '9b8cbb18-3956-43db-81c3-bcb93cd02172', 'a7ddbd1a-5436-48bc-b55a-8bf691572199'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:05 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-c616d3c4-fed7-4146-99db-4a3e2e75acf5-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-c616d3c4-fed7-4146-99db-4a3e2e75acf5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-c616d3c4-fed7-4146-99db-4a3e2e75acf5" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:05 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 0 in 0.578s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-c616d3c4-fed7-4146-99db-4a3e2e75acf5" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:05 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 1073741824" returned: 0 in 0.684s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[324f6d20-3ea6-430a-a360-2a06fdc8218c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.360s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8a0e61e1-5742-46ca-8424-2cbdb1106d16 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-b484b599-50fd-4b2e-bb05-e3dd7182d853-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:05 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 Sep 08 19:36:05 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD Sep 08 19:36:05 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 Sep 08 19:36:05 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD" returned: 1 in 0.446s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] 9de9f57f-c080-4552-973d-18499aaa06fe was raw, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8" returned: 0 in 0.333s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108377578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d43eccb-5074-4829-ae4f-6ace7406fa87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume 5d43eccb-5074-4829-ae4f-6ace7406fa87 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:05 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 Sep 08 19:36:05 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:05 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5" returned: 0 in 0.461s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:05 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 1073741824 Sep 08 19:36:05 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98dae2cb-6cd5-45b0-bd4f-7ad889eca13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c812ddba-6426-464d-8139-d47ef0f934c8', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a37397-bea8-4ce1-b501-43b3cd576512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:05 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-c812ddba-6426-464d-8139-d47ef0f934c8 (c812ddba-6426-464d-8139-d47ef0f934c8): created successfully Sep 08 19:36:05 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5 Sep 08 19:36:05 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a37397-bea8-4ce1-b501-43b3cd576512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (e31b779d-1ba0-4948-add8-772952d8258b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-32d7c2c4-74cb-42ea-9c10-000ea72a4dc4 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:36:06 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c616d3c4-fed7-4146-99db-4a3e2e75acf5" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-c616d3c4-fed7-4146-99db-4a3e2e75acf5" released by "delete_volume" :: held 0.844s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['e99b9685-c3c9-4bc6-8380-b8f8a0ee8bd8', '5c4437d7-2236-49a9-8667-1d204053d918', '9b1b8a59-bb7c-4a1b-a6c1-d581fd60f69b', '6df1c327-af35-4779-8740-78d2e660a619'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:06 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:06 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:06 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 1073741824" returned: 0 in 0.584s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-6b7b519b-30d4-476c-a781-26e4e17671da-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7" returned: 0 in 0.687s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9de9f57f-c080-4552-973d-18499aaa06fe_c0o10rw7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:36:06 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:06 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1G Sep 08 19:36:06 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-6b7b519b-30d4-476c-a781-26e4e17671da-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:06 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 Sep 08 19:36:06 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-6b7b519b-30d4-476c-a781-26e4e17671da" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-6b7b519b-30d4-476c-a781-26e4e17671da" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b46cebd-70ee-476f-8b0a-027b67c28ac5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:06 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5ba4c8e8-6435-45f0-acdb-9c8e344a2bd2 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-c616d3c4-fed7-4146-99db-4a3e2e75acf5-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:06 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da Sep 08 19:36:06 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:06 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87" returned: 0 in 0.412s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.638s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-66703405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11a3cb38-dd75-404c-a67b-2e4dd2eb36ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume 11a3cb38-dd75-404c-a67b-2e4dd2eb36ac {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:06 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a399cc85-2648-4d97-9d62-c501b16ebff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d43eccb-5074-4829-ae4f-6ace7406fa87', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:06 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac 1073741824 Sep 08 19:36:06 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03c6efe-c6e8-44b8-aa9c-0c6740826fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:06 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 1G" returned: 0 in 0.516s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Downloaded image 9de9f57f-c080-4552-973d-18499aaa06fe ((None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}])) to volume aa24b448-b42f-433d-a433-2984fddf6fd7 successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Temporary image 9de9f57f-c080-4552-973d-18499aaa06fe for user 2eedc12d2de8402094c98d26a8779474 is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:36:06 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Marking volume aa24b448-b42f-433d-a433-2984fddf6fd7 as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 (5d43eccb-5074-4829-ae4f-6ace7406fa87): created successfully Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03c6efe-c6e8-44b8-aa9c-0c6740826fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (4028e2b5-6cd1-484f-b67e-385a6cb718a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Copying metadata from image 9de9f57f-c080-4552-973d-18499aaa06fe to aa24b448-b42f-433d-a433-2984fddf6fd7. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Creating volume glance metadata for volume aa24b448-b42f-433d-a433-2984fddf6fd7 backed by image 9de9f57f-c080-4552-973d-18499aaa06fe with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '872dbe962534bb0037c16e00c00e0fdd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5be0b57f-263c-48ad-81f2-b5674bd4453a tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (714d0df7-0af9-4a41-a087-0ded44c298c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa24b448-b42f-433d-a433-2984fddf6fd7', 'volume_size': 1, 'image_id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9de9f57f-c080-4552-973d-18499aaa06fe', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '872dbe962534bb0037c16e00c00e0fdd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '929b5dd25881478f8c5652911fcc4d77', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c073a56c4df3ce223143d057e140a256aba69a3076b40a67a43fed858a7403a2d36a629fc59abb476709e0486ce5dd9d150409ddf3259ae9ec0e7480280adfcf', 'id': '9de9f57f-c080-4552-973d-18499aaa06fe', 'created_at': datetime.datetime(2026, 9, 8, 17, 35, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 35, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9de9f57f-c080-4552-973d-18499aaa06fe/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b327987-a2c1-405c-96d8-7ec115813348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Volume volume-aa24b448-b42f-433d-a433-2984fddf6fd7 (aa24b448-b42f-433d-a433-2984fddf6fd7): created successfully Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b327987-a2c1-405c-96d8-7ec115813348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Flow 'volume_create_manager' (eb955811-0198-4958-afde-129510abf51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e4931f61-04d0-4476-bd1d-2fd65badb86b tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Created volume successfully. Sep 08 19:36:07 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da" returned: 0 in 0.543s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:07 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da Sep 08 19:36:07 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:07 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac 1073741824" returned: 0 in 0.550s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:07 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6b7b519b-30d4-476c-a781-26e4e17671da" returned: 0 in 0.299s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-6b7b519b-30d4-476c-a781-26e4e17671da" released by "delete_volume" :: held 0.907s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:07 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac Sep 08 19:36:07 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['d63eed33-991c-4b2c-ab5f-5a93b1bf7712', '0f1cdbf4-cce0-4180-8fed-807759df50ee', 'e76a8720-1c5d-44e3-9bd5-e835bb52e9ae', '537d78ba-a55b-4dcb-bbd8-ca15aaa26255'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-079fd5e2-650c-47c5-91ee-a28c51f82bfc tempest-ProjectAdminTests-1629816048 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4755859375, 'free_capacity_gb': 1773.4755859375, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87521) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 08 19:36:07 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:07 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:07 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.193s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-301547576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8c6c50-2688-44bc-9fef-d3eeecd71572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5535d2def984c02a9bfc34b796081d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:02Z,use_quota=True,user_id='d5223e1764c7489c8d85d2a5aae0f628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Creating volume 1c8c6c50-2688-44bc-9fef-d3eeecd71572 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656f1c19-185a-443e-9009-3f86777ed6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b91e5ef-8aa3-4211-8014-53a5975b95f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:07 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 1073741824 Sep 08 19:36:07 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac (11a3cb38-dd75-404c-a67b-2e4dd2eb36ac): created successfully Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b91e5ef-8aa3-4211-8014-53a5975b95f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (06157728-5af8-4131-947d-a5b41be0e37a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0cae04d4-18a9-4deb-b2a9-e42aefea2af3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:36:07 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:07 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:07 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-16ea4777-df48-4aa8-8d96-cc963f309c86 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-6b7b519b-30d4-476c-a781-26e4e17671da-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Acquiring lock "cinder-aa24b448-b42f-433d-a433-2984fddf6fd7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "cinder-aa24b448-b42f-433d-a433-2984fddf6fd7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Acquiring lock "cinder-quobyte-aa24b448-b42f-433d-a433-2984fddf6fd7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "cinder-quobyte-aa24b448-b42f-433d-a433-2984fddf6fd7" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[679d8eed-67a8-4bd6-ba60-a823ca8a2014]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:08 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 1073741824" returned: 0 in 0.591s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:08 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 Sep 08 19:36:08 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:08 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 Sep 08 19:36:08 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:08 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6972e8fc-0661-4484-bf82-1a4cf610f51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59cb475-753c-416f-ab55-8cebeba1fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:08 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Volume volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 (1c8c6c50-2688-44bc-9fef-d3eeecd71572): created successfully Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59cb475-753c-416f-ab55-8cebeba1fbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Flow 'volume_create_manager' (789d39a3-d768-462c-b3cd-211b579920d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:08 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-63540f41-cd81-48f8-ae61-a1d2689368c0 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created volume successfully. Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:08 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7" returned: 0 in 0.485s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:08 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7 Sep 08 19:36:08 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f502c65d-dd7e-4eef-abd0-eb67c8b7dc12]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:09 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 Sep 08 19:36:09 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:09 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-aa24b448-b42f-433d-a433-2984fddf6fd7" returned: 0 in 0.281s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "cinder-quobyte-aa24b448-b42f-433d-a433-2984fddf6fd7" released by "delete_volume" :: held 0.831s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Created reservations ['59c6debc-0b74-4790-813a-f6b84803f3d4', '5c5ab3d5-a8bc-4cb3-b7ad-49917c14ddda', '9783848a-9635-4531-bf90-46cdd6ca0827', '59582439-c217-45b6-bee9-08204a317995'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:09 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" returned: 0 in 0.430s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:09 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0 Sep 08 19:36:09 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-1c8c6c50-2688-44bc-9fef-d3eeecd71572-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-1c8c6c50-2688-44bc-9fef-d3eeecd71572-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-1c8c6c50-2688-44bc-9fef-d3eeecd71572" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-1c8c6c50-2688-44bc-9fef-d3eeecd71572" acquired by "delete_volume" :: waited 0.044s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:09 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:09 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[566039fe-6500-4e93-9edc-3b88da4235f3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:09 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0" released by "delete_volume" :: held 0.824s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:09 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 Sep 08 19:36:09 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['76240b2a-12d6-47e4-ad4d-1981e09461d7', 'dc302317-a8ad-407c-bbf7-99f20e0d6b54', 'ae529ef9-8079-47c0-b167-f16b12cfb053', '3edf957b-fcaf-48c2-9595-448aacbfbe02'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:09 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:09 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Deleted volume successfully. Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f57d7639-1418-4d4c-9348-5d6e88d84dba tempest-VolumeAndVolumeTypeFromImageTest-758488633 None] Lock "cinder-aa24b448-b42f-433d-a433-2984fddf6fd7-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:10 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:10 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-a7433136-efe3-4690-a73c-2a235e98c78e-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-a7433136-efe3-4690-a73c-2a235e98c78e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-a7433136-efe3-4690-a73c-2a235e98c78e" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:10 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-a7433136-efe3-4690-a73c-2a235e98c78e" acquired by "delete_volume" :: waited 0.032s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572" returned: 0 in 0.495s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc90ec8-0bbf-4d10-a273-af1d89324881]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:10 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572 Sep 08 19:36:10 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:10 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e Sep 08 19:36:10 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:10 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.321s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-cf960497-ba2f-4287-a93c-f29b9f50fb5d tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-6c18c5b8-cc54-4b00-bf1c-8c9e3cca70e0-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:10 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1c8c6c50-2688-44bc-9fef-d3eeecd71572" returned: 0 in 0.326s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-1c8c6c50-2688-44bc-9fef-d3eeecd71572" released by "delete_volume" :: held 0.882s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['7f1127f0-5659-4625-bfae-e29c1b55a498', '4da8cf45-a134-4a32-9cb9-abacf4bf7fde', 'b7adafcc-8d04-4142-b75b-5ee4ccb95ff2', '331a3332-0c6f-40c3-ba55-4798c8882948'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:10 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e" returned: 0 in 0.468s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:10 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e Sep 08 19:36:10 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:10 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:10 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:10 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-a7433136-efe3-4690-a73c-2a235e98c78e" returned: 0 in 0.315s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-a7433136-efe3-4690-a73c-2a235e98c78e" released by "delete_volume" :: held 0.834s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:11 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.323s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['3f85e663-ee9f-4476-ad64-1ac40a018219', '91735176-512c-4175-8ead-4b32f72b5681', '0c3d1221-8832-43a3-80e6-75f7f119af4b', '6e811d2f-018e-48d1-ae4b-0e59715ff4ee'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-0bd816cd-4837-4872-8c84-3bd6f5d2f1e3 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-1c8c6c50-2688-44bc-9fef-d3eeecd71572-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:11 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:11 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-e1453fb8-c520-40ac-ad34-783bff903dd7-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-e1453fb8-c520-40ac-ad34-783bff903dd7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "cinder-quobyte-e1453fb8-c520-40ac-ad34-783bff903dd7" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-e1453fb8-c520-40ac-ad34-783bff903dd7" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4b11a-3f99-44e8-9bea-0a700196e690]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:11 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.385s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:11 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:11 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 Sep 08 19:36:11 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5cdc4746-fe2d-42e8-9f18-f5b65623a3a7 tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-a7433136-efe3-4690-a73c-2a235e98c78e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" acquired by "delete_volume" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e5ef80-9d5e-40d0-b251-49add8140136]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:11 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7" returned: 0 in 0.596s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:12 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac Sep 08 19:36:12 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:12 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7 Sep 08 19:36:12 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:12 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" returned: 0 in 0.436s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:12 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac Sep 08 19:36:12 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:12 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e1453fb8-c520-40ac-ad34-783bff903dd7" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-quobyte-e1453fb8-c520-40ac-ad34-783bff903dd7" released by "delete_volume" :: held 1.073s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Created reservations ['0b76c78f-e835-4312-af9b-adfdbc14d231', '0b6513f4-2e98-428f-9984-0721691e79c8', '1ffaa312-3a83-4327-9f44-612e6f9b22c8', 'e8d38aaa-fde2-4aa7-943a-cad79ec69772'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:12 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac" released by "delete_volume" :: held 0.798s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:12 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:12 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['4edd084b-4f52-4c06-8d7b-8647400daeaf', '856e16f7-6bbc-4ec0-9711-f6e9e3ed8568', '4d5187d7-4605-4e3a-bc32-a7a1be3f95c2', '2d868c37-d85e-4ada-9e4e-70f24a4a0471'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:12 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:12 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:12 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-5d43eccb-5074-4829-ae4f-6ace7406fa87-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.306s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Deleted volume successfully. Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-5d43eccb-5074-4829-ae4f-6ace7406fa87-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1be649cc-b05f-41d6-b5b0-de0fb864651e tempest-CreateVolumesFromSourceVolumeTest-940234495 None] Lock "cinder-e1453fb8-c520-40ac-ad34-783bff903dd7-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-5d43eccb-5074-4829-ae4f-6ace7406fa87" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-5d43eccb-5074-4829-ae4f-6ace7406fa87" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c12fd7-4f72-47e4-a2c2-79c643cb2ff8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:13 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.320s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-645828fb-4de4-48da-8537-9e6c7b526e09 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-11a3cb38-dd75-404c-a67b-2e4dd2eb36ac-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:13 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 Sep 08 19:36:13 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:13 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87" returned: 0 in 0.470s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:13 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87 Sep 08 19:36:13 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:13 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5d43eccb-5074-4829-ae4f-6ace7406fa87" returned: 0 in 0.312s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-5d43eccb-5074-4829-ae4f-6ace7406fa87" released by "delete_volume" :: held 0.840s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:13 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['28f01d2e-8a10-44bf-a928-f5f8dda83f4c', 'e62a9592-4983-4192-8cf0-7a6e5cae97c9', '514dc254-e688-4221-b664-7e4cf5dd2a45', '3638a8a4-a93d-416d-9f45-e0abe64f6cdb'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:14 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:14 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-c812ddba-6426-464d-8139-d47ef0f934c8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-c812ddba-6426-464d-8139-d47ef0f934c8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-c812ddba-6426-464d-8139-d47ef0f934c8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-c812ddba-6426-464d-8139-d47ef0f934c8" acquired by "delete_volume" :: waited 0.040s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd39fe2-d260-4e69-953a-18a735bbf86e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:14 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:14 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.418s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-31db8d9a-923c-4588-a8fd-8b70324721a6 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-5d43eccb-5074-4829-ae4f-6ace7406fa87-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:14 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:14 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8" returned: 0 in 0.452s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:14 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8 Sep 08 19:36:14 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:15 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:15 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:15 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c812ddba-6426-464d-8139-d47ef0f934c8" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-c812ddba-6426-464d-8139-d47ef0f934c8" released by "delete_volume" :: held 0.901s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['dd35c843-6b0b-43d7-8815-ecfacb26cf01', 'e0e444ae-2608-4e93-92a0-b97d8bb8cd1b', 'dc11fa89-5a08-44e5-85e1-87f59b54cf02', 'f808c384-e642-4549-9fe0-ee99d9caa17b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:15 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.472s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:15 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:15 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:15 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.279s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-6fed07be-6e8c-4854-a64f-5512d7bd8689 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-c812ddba-6426-464d-8139-d47ef0f934c8-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-11322045-d790-4040-b87d-7fa07e72526c-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-11322045-d790-4040-b87d-7fa07e72526c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-11322045-d790-4040-b87d-7fa07e72526c" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-11322045-d790-4040-b87d-7fa07e72526c" acquired by "delete_volume" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[577cf940-8b3d-44b9-bbdb-5eb85c4e2bc1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:16 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c Sep 08 19:36:16 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:17 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:17 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c Sep 08 19:36:17 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:17 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-11322045-d790-4040-b87d-7fa07e72526c" returned: 0 in 0.262s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-11322045-d790-4040-b87d-7fa07e72526c" released by "delete_volume" :: held 0.694s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['125c3ed9-9277-4190-8718-339b1979a136', '7558f9ad-9ed7-4c50-9189-18ca5effac42', '82b5fa60-f9c8-4c35-b934-d6614f3b5c58', '1bcf4755-78da-4f04-b927-4d5313df5861'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:17 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:17 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:17 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.395s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f333fba6-228b-4514-8d5c-12b37791530d tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-11322045-d790-4040-b87d-7fa07e72526c-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleting offline snapshot d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 of volume 172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] snapshot_file for this snap is: volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4713d88-f613-4d7e-9cfb-95f6e62d781e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:18 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 Sep 08 19:36:18 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:18 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" returned: 0 in 0.449s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-172c3c0b-8643-4dfe-a1d0-340f109fad90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d285b7-3f9e-4d34-a70f-ec115b7e911b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:18 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 Sep 08 19:36:18 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:18 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90" returned: 0 in 0.401s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:18 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 Sep 08 19:36:18 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:19 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" returned: 0 in 0.514s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:19 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4 Sep 08 19:36:19 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Flow 'volume_create_manager' (0befd6b3-2837-4f9e-b2b3-dcdfc65eb743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c65b7ee-8381-4651-a29b-2720e4c08b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c65b7ee-8381-4651-a29b-2720e4c08b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dab209c-ba68-4c4e-b474-34be2890facc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061947ad1e9f40ec83dd62b27b5d755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:20Z,use_quota=True,user_id='6be7012afa8e4739850bb022bef7d7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca1dd56-ce49-461d-b3c3-a965290cdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca1dd56-ce49-461d-b3c3-a965290cdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be49ac3b-ad58-44eb-8e8a-8ff1eb531104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.image.glance [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Creating Keystone auth plugin from conf {{(pid=87521) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 08 19:36:19 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90.d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" returned: 0 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4" released by "_delete_snapshot" :: held 1.884s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" released by "delete_snapshot" :: held 1.919s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:19 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['270617f6-a990-4d32-8d24-705f6290d172', '9d1d4334-1648-4254-adcc-ee675b189ecc', 'f3f38ffb-f289-49c8-98ca-95426f90534c', '75e5c1a1-a8b5-4e89-bea5-d42c3014c940'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Delete snapshot completed successfully. Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-55bbe520-8c78-4b6d-a9e2-90242c602038 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-d617ee50-43ed-4f10-b0cc-a0c36dc8d2e4-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be49ac3b-ad58-44eb-8e8a-8ff1eb531104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1dab209c-ba68-4c4e-b474-34be2890facc', 'volume_name': 'volume-1dab209c-ba68-4c4e-b474-34be2890facc', 'volume_size': 1, 'image_id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95557b37ff456e3626a0316d4a1f50e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061947ad1e9f40ec83dd62b27b5d755e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1511b7a6d9329f9a8a2e20a061eb1a8afbbcda6d2723c98e17dcb6cd1ad58ee68fe9c59485492bd21bd9673f94f6e458ab05d3ec65af78698ef70a39224f1a28', 'id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'created_at': datetime.datetime(2026, 9, 8, 17, 36, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 36, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcaf73c-5239-4ddd-85f5-b498157eb784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcaf73c-5239-4ddd-85f5-b498157eb784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650812b3-bd2f-4aeb-bea0-799ee7ade312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:20 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Volume 1dab209c-ba68-4c4e-b474-34be2890facc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1dab209c-ba68-4c4e-b474-34be2890facc', 'volume_size': 1, 'image_id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95557b37ff456e3626a0316d4a1f50e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061947ad1e9f40ec83dd62b27b5d755e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1511b7a6d9329f9a8a2e20a061eb1a8afbbcda6d2723c98e17dcb6cd1ad58ee68fe9c59485492bd21bd9673f94f6e458ab05d3ec65af78698ef70a39224f1a28', 'id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'created_at': datetime.datetime(2026, 9, 8, 17, 36, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 36, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f/file', 'properties': {}}, 'image_service': } Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Trying to clone 1dab209c-ba68-4c4e-b474-34be2890facc from image af3567fc-3f4a-4dc1-a4b4-1135db4da70f at location (None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}]). {{(pid=87521) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-172c3c0b-8643-4dfe-a1d0-340f109fad90-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-172c3c0b-8643-4dfe-a1d0-340f109fad90-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 08 19:36:20 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Image download 0.00 MB at 0.00 MB/s Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd9be1a-d55d-4d5d-8908-d4e1fd0d0fe8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a48fdf-3ca2-4bf3-b974-d6d7c2b3962b]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:20 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 Sep 08 19:36:20 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:20 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:20 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:20 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90" returned: 0 in 0.423s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:20 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90 Sep 08 19:36:20 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:20 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:20 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:20 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:21 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-172c3c0b-8643-4dfe-a1d0-340f109fad90" returned: 0 in 0.266s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-quobyte-172c3c0b-8643-4dfe-a1d0-340f109fad90" released by "delete_volume" :: held 0.790s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Created reservations ['3af4180f-f022-4fad-a0ec-3378ded5d4ba', 'b55a3a35-4438-4e54-be99-53368e746ce8', '7aeec363-fdcd-4385-97a3-b52f6e164198', 'c743448e-9d5a-49a5-a5a1-0e1503ae213b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:21 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Temporary image af3567fc-3f4a-4dc1-a4b4-1135db4da70f is fetched for user 6be7012afa8e4739850bb022bef7d7d2. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:21 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:21 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95a6e32-1fbc-4416-938e-025726351281]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:21 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:21 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:21 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.411s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Deleted volume successfully. Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c9384262-78bd-4c0d-96e1-d96d9bcacf12 tempest-CreateVolumesFromSnapshotTest-1704952012 None] Lock "cinder-172c3c0b-8643-4dfe-a1d0-340f109fad90-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:21 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:21 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:21 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:22 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dab209c-ba68-4c4e-b474-34be2890facc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='061947ad1e9f40ec83dd62b27b5d755e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:20Z,use_quota=True,user_id='6be7012afa8e4739850bb022bef7d7d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Creating volume 1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:22 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:22 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1073741824 Sep 08 19:36:22 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:22 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1073741824" returned: 0 in 0.663s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:22 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc Sep 08 19:36:22 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:23 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc" returned: 0 in 0.408s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Attempting download of af3567fc-3f4a-4dc1-a4b4-1135db4da70f ((None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}])) to volume 1dab209c-ba68-4c4e-b474-34be2890facc. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f258e54-6384-4408-9bf7-ef7a5b0d118c]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:23 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa Sep 08 19:36:23 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:23 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa" returned: 0 in 0.429s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:23 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa Sep 08 19:36:23 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:24 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa" returned: 1 in 0.582s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_jfjz8lqa' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[43243370-40aa-48d6-bce0-95c603f4fb7d]: (4, 'raw') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:24 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:24 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:24 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:24 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD Sep 08 19:36:24 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:25 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] af3567fc-3f4a-4dc1-a4b4-1135db4da70f was raw, converting to qcow2 {{(pid=87521) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:25 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc Sep 08 19:36:25 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Flow 'volume_create_manager' (fd5e7166-f8de-47c6-9748-c479f7b8d2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b16460-0e2d-4eaf-bfd1-2973a9d6b141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b16460-0e2d-4eaf-bfd1-2973a9d6b141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2045008621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96988d60-a69b-48d1-8f0f-0b990a18dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bc1e4e415a4582ba70592d2fc78689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:25Z,use_quota=True,user_id='e45e7428ea7248f5b770ec0fc23d99b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20706c05-16f2-4b75-b0e9-b9c460d3f96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20706c05-16f2-4b75-b0e9-b9c460d3f96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea001a4c-1d2e-4f89-8888-bd54312f34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea001a4c-1d2e-4f89-8888-bd54312f34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96988d60-a69b-48d1-8f0f-0b990a18dcaa', 'volume_name': 'volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55be03a-7884-423c-bb3f-f15af9817457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55be03a-7884-423c-bb3f-f15af9817457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc1e62-39c1-4850-a0cc-276ab52db068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:25 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Volume 96988d60-a69b-48d1-8f0f-0b990a18dcaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa', 'volume_size': 1} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2045008621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96988d60-a69b-48d1-8f0f-0b990a18dcaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bc1e4e415a4582ba70592d2fc78689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:25Z,use_quota=True,user_id='e45e7428ea7248f5b770ec0fc23d99b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Creating volume 96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:25 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:25 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa 1073741824 Sep 08 19:36:25 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:25 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc" returned: 0 in 0.608s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af3567fc-3f4a-4dc1-a4b4-1135db4da70f_v0vos2itdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:36:25 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Converted 0.00 MB image at 0.00 MB/s Sep 08 19:36:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:25 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1G Sep 08 19:36:25 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:26 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa 1073741824" returned: 0 in 0.583s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:26 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:26 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:26 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc 1G" returned: 0 in 0.504s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Downloaded image af3567fc-3f4a-4dc1-a4b4-1135db4da70f ((None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}])) to volume 1dab209c-ba68-4c4e-b474-34be2890facc successfully. {{(pid=87521) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Temporary image af3567fc-3f4a-4dc1-a4b4-1135db4da70f for user 6be7012afa8e4739850bb022bef7d7d2 is deleted. {{(pid=87521) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.volume_utils [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Marking volume 1dab209c-ba68-4c4e-b474-34be2890facc as bootable. {{(pid=87521) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Copying metadata from image af3567fc-3f4a-4dc1-a4b4-1135db4da70f to 1dab209c-ba68-4c4e-b474-34be2890facc. {{(pid=87521) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Creating volume glance metadata for volume 1dab209c-ba68-4c4e-b474-34be2890facc backed by image af3567fc-3f4a-4dc1-a4b4-1135db4da70f with: {'image_id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '95557b37ff456e3626a0316d4a1f50e4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87521) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650812b3-bd2f-4aeb-bea0-799ee7ade312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dab209c-ba68-4c4e-b474-34be2890facc', 'volume_size': 1, 'image_id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '95557b37ff456e3626a0316d4a1f50e4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '061947ad1e9f40ec83dd62b27b5d755e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1511b7a6d9329f9a8a2e20a061eb1a8afbbcda6d2723c98e17dcb6cd1ad58ee68fe9c59485492bd21bd9673f94f6e458ab05d3ec65af78698ef70a39224f1a28', 'id': 'af3567fc-3f4a-4dc1-a4b4-1135db4da70f', 'created_at': datetime.datetime(2026, 9, 8, 17, 36, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 8, 17, 36, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af3567fc-3f4a-4dc1-a4b4-1135db4da70f/file', 'properties': {}}, 'image_service': }' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40d7247-3345-4baf-9872-ee75b19d2fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:26 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Volume volume-1dab209c-ba68-4c4e-b474-34be2890facc (1dab209c-ba68-4c4e-b474-34be2890facc): created successfully Sep 08 19:36:26 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40d7247-3345-4baf-9872-ee75b19d2fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Flow 'volume_create_manager' (0befd6b3-2837-4f9e-b2b3-dcdfc65eb743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.318s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc1e62-39c1-4850-a0cc-276ab52db068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf539f2-e53f-4d34-9c5f-d39e5fbdb219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:26 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-31dbb74f-68e8-443b-bc64-096016748b98 tempest-VolumeImageDependencyTests-590322634 None] Created volume successfully. Sep 08 19:36:26 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Volume volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa (96988d60-a69b-48d1-8f0f-0b990a18dcaa): created successfully Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf539f2-e53f-4d34-9c5f-d39e5fbdb219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Flow 'volume_create_manager' (fd5e7166-f8de-47c6-9748-c479f7b8d2f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:26 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9d259ec6-66b5-4cb6-9653-7ddfbe2caa92 tempest-VolumeDependencyTests-1801009367 None] Created volume successfully. Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Acquiring lock "cinder-1dab209c-ba68-4c4e-b474-34be2890facc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "cinder-1dab209c-ba68-4c4e-b474-34be2890facc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Acquiring lock "cinder-quobyte-1dab209c-ba68-4c4e-b474-34be2890facc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "cinder-quobyte-1dab209c-ba68-4c4e-b474-34be2890facc" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[528fe194-4d9b-4cb4-9dc1-96807b11f482]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:27 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc Sep 08 19:36:27 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:27 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc" returned: 0 in 0.441s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:27 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc Sep 08 19:36:27 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Creating offline snapshot 5ac05c7a-9acc-4835-acbe-3452656e6ad1 of volume 96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:36:27 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-1dab209c-ba68-4c4e-b474-34be2890facc" returned: 0 in 0.369s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b80473-ad00-416b-b75f-94afd1b8649b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "cinder-quobyte-1dab209c-ba68-4c4e-b474-34be2890facc" released by "delete_volume" :: held 0.878s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Created reservations ['3864f463-2732-4026-8ae3-ce506d4f755a', '3514c084-195c-4710-aa6e-49b1451b8f95', 'af4d4a16-f7a0-4187-a01f-dc20d4d1718a', '41423fcd-f44d-42dd-8046-d11e0e3f65e9'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:27 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:27 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:28 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:28 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:28 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.517s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:28 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 1G Sep 08 19:36:28 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:28 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Deleted volume successfully. Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f24cc349-2c84-4f15-bfcc-95b55144bb48 tempest-VolumeImageDependencyTests-590322634 None] Lock "cinder-1dab209c-ba68-4c4e-b474-34be2890facc-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:28 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 1G" returned: 0 in 0.585s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:28 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:28 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:29 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.372s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:29 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 is being set with open permissions: ugo+rw Sep 08 19:36:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:29 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:29 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:29 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:29 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info Sep 08 19:36:29 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:30 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:30 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info is being set with open permissions: ugo+rw Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:30 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info Sep 08 19:36:30 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (1796a429-870a-4889-a84d-fc2758cbb008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d250cd91-318f-45e5-8ec6-29d3e992b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d250cd91-318f-45e5-8ec6-29d3e992b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094995081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ff2b4f-dc7c-4878-83ec-7ad17fc59d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:30Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976d459f-2787-480f-babc-64621f92325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976d459f-2787-480f-babc-64621f92325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d588c01c-c804-40b1-a56d-5f4a1ff0e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d588c01c-c804-40b1-a56d-5f4a1ff0e394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ff2b4f-dc7c-4878-83ec-7ad17fc59d79', 'volume_name': 'volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e8e797-8dc9-46c6-8f9d-343dc01475e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e8e797-8dc9-46c6-8f9d-343dc01475e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1612c-db1f-47d0-9e98-ef0bb98984d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Volume 12ff2b4f-dc7c-4878-83ec-7ad17fc59d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79', 'volume_size': 1} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:30 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.info" returned: 0 in 0.502s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.079s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2094995081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ff2b4f-dc7c-4878-83ec-7ad17fc59d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:30Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Creating volume 12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:30 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 1073741824 Sep 08 19:36:30 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e77af878-3d08-4878-a55d-595066239049 tempest-VolumeDependencyTests-1801009367 None] Create snapshot completed successfully Sep 08 19:36:31 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 1073741824" returned: 0 in 0.561s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:31 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 Sep 08 19:36:31 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:31 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" returned: 0 in 0.309s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f1612c-db1f-47d0-9e98-ef0bb98984d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada4a6b8-242a-400c-8800-776a344b86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Volume volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 (12ff2b4f-dc7c-4878-83ec-7ad17fc59d79): created successfully Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada4a6b8-242a-400c-8800-776a344b86f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (1796a429-870a-4889-a84d-fc2758cbb008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1366a0bf-bb19-4f18-a3ca-56adcb5d0114 tempest-ProjectReaderTests-859995860 None] Created volume successfully. Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Flow 'volume_create_manager' (4b80d4e9-3b8e-4773-a42a-5e726717e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df1d29-a5e5-4d32-81d1-940c9b646540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6df1d29-a5e5-4d32-81d1-940c9b646540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1167023040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23e13f40-2579-48af-a91f-1b2bee3c3034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7bc1e4e415a4582ba70592d2fc78689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ac05c7a-9acc-4835-acbe-3452656e6ad1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:31Z,use_quota=True,user_id='e45e7428ea7248f5b770ec0fc23d99b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38774736-007c-4289-b295-9aec4779fcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38774736-007c-4289-b295-9aec4779fcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb29446-01cc-4e9b-b61d-be126f641b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb29446-01cc-4e9b-b61d-be126f641b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23e13f40-2579-48af-a91f-1b2bee3c3034', 'volume_name': 'volume-23e13f40-2579-48af-a91f-1b2bee3c3034', 'volume_size': 1, 'snapshot_id': '5ac05c7a-9acc-4835-acbe-3452656e6ad1'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb1e74-b819-4ed5-8a01-0845809d3eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cb1e74-b819-4ed5-8a01-0845809d3eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58696e08-6a57-49d0-8a08-e1c7e0748b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Volume 23e13f40-2579-48af-a91f-1b2bee3c3034: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23e13f40-2579-48af-a91f-1b2bee3c3034', 'volume_size': 1, 'snapshot_id': '5ac05c7a-9acc-4835-acbe-3452656e6ad1'} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1-23e13f40-2579-48af-a91f-1b2bee3c3034" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1-23e13f40-2579-48af-a91f-1b2bee3c3034" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Creating volume 23e13f40-2579-48af-a91f-1b2bee3c3034 from snapshot 5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] snapshot: 5ac05c7a-9acc-4835-acbe-3452656e6ad1, volume: 23e13f40-2579-48af-a91f-1b2bee3c3034, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c34fc4-9d5b-4eb9-8f60-b1f3cdb49182]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:31 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:31 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:32 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.432s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc8ab2d-bc61-4d18-bd03-8516f1a421e7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Flow 'volume_create_manager' (cdb3a997-e27a-4e29-b167-4b6deadf9b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2570f8-831b-4693-8757-8c7d0f0fd18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:32 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:32 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2570f8-831b-4693-8757-8c7d0f0fd18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452a65c-3297-4b10-83ce-2c2f94e4152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e3e5c1443847f09ee10c37883ab8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:32Z,use_quota=True,user_id='74e90c7c70b64e4fa1d0b663d8f6fbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838a4d00-3219-4bf6-a482-8f41ca3cd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838a4d00-3219-4bf6-a482-8f41ca3cd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be5aea8-dded-445d-864e-405ff8163090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be5aea8-dded-445d-864e-405ff8163090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd452a65c-3297-4b10-83ce-2c2f94e4152a', 'volume_name': 'volume-d452a65c-3297-4b10-83ce-2c2f94e4152a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e674b6-af8e-448b-8c08-ce94cfbec65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e674b6-af8e-448b-8c08-ce94cfbec65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d380bbfa-8de2-47c7-a913-4348a694c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:32 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Volume d452a65c-3297-4b10-83ce-2c2f94e4152a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d452a65c-3297-4b10-83ce-2c2f94e4152a', 'volume_size': 1} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:32 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.431s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:32 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 Sep 08 19:36:32 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "cinder-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-quobyte-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ae21d2-ff83-4764-a7b3-eb550e5693ac]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:32 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 Sep 08 19:36:32 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:33 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" returned: 0 in 0.586s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:33 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79 Sep 08 19:36:33 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:34 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" returned: 0 in 0.961s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79" released by "delete_volume" :: held 1.596s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Created reservations ['c6f09215-30bd-474d-9b8b-6ef7de4ff342', 'bae63f4b-5c5a-45fe-a6a2-3a238c106b21', '95a9bb58-04bc-4396-ac21-3cd51aa04842', 'acc1b22d-0bbc-42df-8a61-89f901c4d2a9'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:34 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:34 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:35 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.809s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:35 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Deleted volume successfully. Sep 08 19:36:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1730299e-0f0d-428a-9537-d4986735c7f0 tempest-ProjectReaderTests-859995860 None] Lock "cinder-12ff2b4f-dc7c-4878-83ec-7ad17fc59d79-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (b29d8d69-ce64-4ece-8b1b-c53850c7d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34961dbb-f58d-4892-a2c7-d7a59c792ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34961dbb-f58d-4892-a2c7-d7a59c792ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258484327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cfad58-4ebc-4d0c-ad34-b545a3653dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:36Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180cf5a9-398b-43f4-be7c-af8f30e20ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (180cf5a9-398b-43f4-be7c-af8f30e20ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54976e-94a0-4aea-915f-3a1cac93193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a54976e-94a0-4aea-915f-3a1cac93193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51cfad58-4ebc-4d0c-ad34-b545a3653dc3', 'volume_name': 'volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8e54f0-6b05-4902-89d3-a543792ebf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee8e54f0-6b05-4902-89d3-a543792ebf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ddff7e-b7f5-41b7-a0f3-450331e6b2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:36 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Volume 51cfad58-4ebc-4d0c-ad34-b545a3653dc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3', 'volume_size': 1} Sep 08 19:36:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:38 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034" returned: 0 in 5.761s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:36:38 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Converted 1024.00 MB image at 177.66 MB/s Sep 08 19:36:38 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 is being set with open permissions: ugo+rw Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:38 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 Sep 08 19:36:38 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:38 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" released by "_copy_volume_from_snapshot" :: held 6.952s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1-23e13f40-2579-48af-a91f-1b2bee3c3034" released by "_create_volume_from_snapshot" :: held 7.014s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.032s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.315s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d452a65c-3297-4b10-83ce-2c2f94e4152a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e3e5c1443847f09ee10c37883ab8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:32Z,use_quota=True,user_id='74e90c7c70b64e4fa1d0b663d8f6fbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Creating volume d452a65c-3297-4b10-83ce-2c2f94e4152a {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:38 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:38 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a 1073741824 Sep 08 19:36:38 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58696e08-6a57-49d0-8a08-e1c7e0748b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23e13f40-2579-48af-a91f-1b2bee3c3034', 'volume_size': 1, 'snapshot_id': '5ac05c7a-9acc-4835-acbe-3452656e6ad1'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec83741-8da7-4bb4-9136-df6319c0d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Volume volume-23e13f40-2579-48af-a91f-1b2bee3c3034 (23e13f40-2579-48af-a91f-1b2bee3c3034): created successfully Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec83741-8da7-4bb4-9136-df6319c0d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Flow 'volume_create_manager' (4b80d4e9-3b8e-4773-a42a-5e726717e908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f6271ee8-137c-48c1-8f90-3e28c5c74edb tempest-VolumeDependencyTests-1801009367 None] Created volume successfully. Sep 08 19:36:39 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a 1073741824" returned: 0 in 0.572s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:39 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a Sep 08 19:36:39 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-5ac05c7a-9acc-4835-acbe-3452656e6ad1-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-5ac05c7a-9acc-4835-acbe-3452656e6ad1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Deleting offline snapshot 5ac05c7a-9acc-4835-acbe-3452656e6ad1 of volume 96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] snapshot_file for this snap is: volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4b4931-3908-43f6-803c-0055905fb138]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:39 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a" returned: 0 in 0.291s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.994s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-258484327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51cfad58-4ebc-4d0c-ad34-b545a3653dc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:36Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Creating volume 51cfad58-4ebc-4d0c-ad34-b545a3653dc3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:39 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:39 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:39 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:39 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 1073741824 Sep 08 19:36:39 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d380bbfa-8de2-47c7-a913-4348a694c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d452a65c-3297-4b10-83ce-2c2f94e4152a', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232477fc-7187-4ed8-851a-f9b193e59fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:39 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Volume volume-d452a65c-3297-4b10-83ce-2c2f94e4152a (d452a65c-3297-4b10-83ce-2c2f94e4152a): created successfully Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (232477fc-7187-4ed8-851a-f9b193e59fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Flow 'volume_create_manager' (cdb3a997-e27a-4e29-b167-4b6deadf9b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:39 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-34ac1a11-5447-41b2-b60e-4dea58808b95 tempest-CinderUnicodeTest-1299086873 None] Created volume successfully. Sep 08 19:36:39 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c0507b-5354-41fd-ae9f-d2a0423b5fb0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:40 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:40 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:40 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 1073741824" returned: 0 in 0.544s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:40 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 Sep 08 19:36:40 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:40 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" returned: 0 in 0.318s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ddff7e-b7f5-41b7-a0f3-450331e6b2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608c49d-13c4-441e-a397-316f1d86f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:40 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Volume volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 (51cfad58-4ebc-4d0c-ad34-b545a3653dc3): created successfully Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b608c49d-13c4-441e-a397-316f1d86f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (b29d8d69-ce64-4ece-8b1b-c53850c7d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-06c6ef87-feb8-4ffe-8a7e-ba510929fdd5 tempest-ProjectReaderTests-859995860 None] Created volume successfully. Sep 08 19:36:40 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.709s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:40 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:40 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Flow 'volume_create_manager' (f4646084-9c08-47c5-8f7b-616b7b02b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19f2401-2eac-40c1-82eb-47bcc1214551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:40 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19f2401-2eac-40c1-82eb-47bcc1214551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1773471514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b07706-5796-4870-a461-2733be9bc49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e3e5c1443847f09ee10c37883ab8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:41Z,use_quota=True,user_id='74e90c7c70b64e4fa1d0b663d8f6fbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f2bdc9-ce22-49fc-9d0c-152529f344b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f2bdc9-ce22-49fc-9d0c-152529f344b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfaf7786-f0b9-432d-87a8-bf3dd1c40028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfaf7786-f0b9-432d-87a8-bf3dd1c40028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b07706-5796-4870-a461-2733be9bc49b', 'volume_name': 'volume-08b07706-5796-4870-a461-2733be9bc49b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2145dc02-948e-45fd-995a-8ad03a00f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2145dc02-948e-45fd-995a-8ad03a00f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d68922-f037-44ea-815a-bce026e8d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:41 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Volume 08b07706-5796-4870-a461-2733be9bc49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b07706-5796-4870-a461-2733be9bc49b', 'volume_size': 1} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1773471514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b07706-5796-4870-a461-2733be9bc49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7e3e5c1443847f09ee10c37883ab8d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:41Z,use_quota=True,user_id='74e90c7c70b64e4fa1d0b663d8f6fbbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Creating volume 08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:41 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:41 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b 1073741824 Sep 08 19:36:41 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:41 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.419s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:41 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1 Sep 08 19:36:41 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:41 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa.5ac05c7a-9acc-4835-acbe-3452656e6ad1" returned: 0 in 0.265s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-5ac05c7a-9acc-4835-acbe-3452656e6ad1" released by "_delete_snapshot" :: held 1.918s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" released by "delete_snapshot" :: held 1.946s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Created reservations ['027f5c81-7e0f-417f-86d4-cb59a1c257c0', 'ef07d8e6-4341-40b9-afed-14637da59c5d', '5ee58dac-503d-47bd-aed5-56a61dc358f3', '1e029d11-d8d5-471c-aef5-c1604bc23b42'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:41 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b 1073741824" returned: 0 in 0.525s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Delete snapshot completed successfully. Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-912fd55b-7d3b-4b0f-9993-09e5e19b12b3 tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-5ac05c7a-9acc-4835-acbe-3452656e6ad1-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:41 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b Sep 08 19:36:41 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-96988d60-a69b-48d1-8f0f-0b990a18dcaa-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-96988d60-a69b-48d1-8f0f-0b990a18dcaa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-51cfad58-4ebc-4d0c-ad34-b545a3653dc3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "cinder-51cfad58-4ebc-4d0c-ad34-b545a3653dc3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-quobyte-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" acquired by "delete_volume" :: waited 0.038s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" acquired by "delete_volume" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae46fdf-4706-47aa-a87c-53e8f9b8101a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a077e30c-4dda-417b-9816-fd965903be1e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:41 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d68922-f037-44ea-815a-bce026e8d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b07706-5796-4870-a461-2733be9bc49b', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ca4ab-0dc6-4714-8dcb-1d53f15159f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:42 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Volume volume-08b07706-5796-4870-a461-2733be9bc49b (08b07706-5796-4870-a461-2733be9bc49b): created successfully Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d24ca4ab-0dc6-4714-8dcb-1d53f15159f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Flow 'volume_create_manager' (f4646084-9c08-47c5-8f7b-616b7b02b884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c7885480-f480-4f10-a326-08cd0858b5fc tempest-CinderUnicodeTest-1299086873 None] Created volume successfully. Sep 08 19:36:42 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:42 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:42 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 Sep 08 19:36:42 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:42 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:42 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:42 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa Sep 08 19:36:42 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:42 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3 Sep 08 19:36:42 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:42 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-96988d60-a69b-48d1-8f0f-0b990a18dcaa" returned: 0 in 0.309s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-96988d60-a69b-48d1-8f0f-0b990a18dcaa" released by "delete_volume" :: held 0.783s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:42 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-51cfad58-4ebc-4d0c-ad34-b545a3653dc3" released by "delete_volume" :: held 0.794s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Created reservations ['704760e5-682d-47f2-ac52-d7650f1aa648', '64034977-ad01-4721-b747-f6935b8b50ac', 'c79926a3-9d10-4d4d-b8fa-59281b312ad1', '43e3ef21-8bda-4b81-b05b-ab5ef43c6c4e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Created reservations ['506f0400-c84b-43d5-a469-81bcf3677ac7', '4aa9152a-e384-40b4-86cf-22cdc4397159', '98279936-cb24-446c-b549-e8c35b7681b3', '860c9fd4-b143-45dc-82fa-67ad05556ecf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-23e13f40-2579-48af-a91f-1b2bee3c3034-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:42 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:42 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-23e13f40-2579-48af-a91f-1b2bee3c3034-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:43 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:43 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" acquired by "delete_volume" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b09aed-b59e-4eed-8cce-c7542288c7d9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:43 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.335s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Deleted volume successfully. Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-4c64583a-1a8a-4a36-9695-255dbd384c5a tempest-ProjectReaderTests-859995860 None] Lock "cinder-51cfad58-4ebc-4d0c-ad34-b545a3653dc3-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:43 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.527s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Deleted volume successfully. Sep 08 19:36:43 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 Sep 08 19:36:43 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e52b6cda-a257-4f10-8cc7-5a8cf701c2bf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-96988d60-a69b-48d1-8f0f-0b990a18dcaa-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:43 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034" returned: 0 in 0.560s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:43 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034 Sep 08 19:36:43 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (70bd1228-19db-4c97-9578-86c9e23cdc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa75626e-a6b3-438c-b0f0-7738b0cbd251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Creating offline snapshot 353af1e3-75b0-4a3c-8c53-2b3acc761861 of volume 08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa75626e-a6b3-438c-b0f0-7738b0cbd251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220604684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd46b0de-cbb0-48b4-9eea-20dea7e8f872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:44Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0592b5-ea24-4239-8105-43d68cf758ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0592b5-ea24-4239-8105-43d68cf758ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31a1209-2531-4a69-8ee6-87a1309880b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b31a1209-2531-4a69-8ee6-87a1309880b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd46b0de-cbb0-48b4-9eea-20dea7e8f872', 'volume_name': 'volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ce6930-8760-4a14-acb6-6536c97b2964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ce6930-8760-4a14-acb6-6536c97b2964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aef3e7-4ff7-457e-8ffb-558e7c7d8071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:43 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Volume fd46b0de-cbb0-48b4-9eea-20dea7e8f872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872', 'volume_size': 1} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac67729-d19c-4bd0-904d-06e5ec1ad47c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:44 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-23e13f40-2579-48af-a91f-1b2bee3c3034" returned: 0 in 0.294s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-quobyte-23e13f40-2579-48af-a91f-1b2bee3c3034" released by "delete_volume" :: held 0.916s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:44 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b Sep 08 19:36:44 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Created reservations ['90d59bd3-e10f-4720-b964-0d804650a212', '6fcecf68-866f-4f76-861a-cfeeaa01bdae', '53408bf6-8324-477e-9a72-788f3e810f30', 'f05560c2-6466-4d8a-a54b-831e0bb650a0'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:44 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:44 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:44 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b" returned: 0 in 0.415s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:44 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 1G Sep 08 19:36:44 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:44 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Deleted volume successfully. Sep 08 19:36:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-1eeafdc0-f16d-492a-8571-b11079f32cbf tempest-VolumeDependencyTests-1801009367 None] Lock "cinder-23e13f40-2579-48af-a91f-1b2bee3c3034-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:45 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 1G" returned: 0 in 0.674s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b07706-5796-4870-a461-2733be9bc49b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:45 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b07706-5796-4870-a461-2733be9bc49b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 Sep 08 19:36:45 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:45 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b07706-5796-4870-a461-2733be9bc49b -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861" returned: 0 in 0.405s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:45 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 is being set with open permissions: ugo+rw Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:45 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 Sep 08 19:36:45 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:45 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:45 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info Sep 08 19:36:45 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:46 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info" returned: 0 in 0.319s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:46 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info is being set with open permissions: ugo+rw Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:46 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info Sep 08 19:36:46 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:46 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.info" returned: 0 in 0.358s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.715s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220604684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd46b0de-cbb0-48b4-9eea-20dea7e8f872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:44Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Creating volume fd46b0de-cbb0-48b4-9eea-20dea7e8f872 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:46 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:46 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 1073741824 Sep 08 19:36:46 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:46 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d4b2be8a-61a6-409a-8da9-a540c9e87a87 tempest-CinderUnicodeTest-1299086873 None] Create snapshot completed successfully Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-353af1e3-75b0-4a3c-8c53-2b3acc761861-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-353af1e3-75b0-4a3c-8c53-2b3acc761861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:46 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-quobyte-353af1e3-75b0-4a3c-8c53-2b3acc761861" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-353af1e3-75b0-4a3c-8c53-2b3acc761861" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Deleting offline snapshot 353af1e3-75b0-4a3c-8c53-2b3acc761861 of volume 08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] snapshot_file for this snap is: volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db47d1f-42b2-47b9-972e-7233e8db8e65]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:47 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 1073741824" returned: 0 in 0.593s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=271,cinder:SELECT=205,cinder:DELETE=21,cinder:INSERT=76 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:47 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 Sep 08 19:36:47 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:47 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 Sep 08 19:36:47 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:47 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" returned: 0 in 0.340s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:47 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861" returned: 0 in 0.486s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08b07706-5796-4870-a461-2733be9bc49b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50aef3e7-4ff7-457e-8ffb-558e7c7d8071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b23f605-893f-4488-9b1f-e521ca4421c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[02456cef-2c51-43ab-bd51-f7b14fbac838]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=199,cinder:UPDATE=289,cinder:INSERT=72,cinder:DELETE=30 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:36:47 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Volume volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 (fd46b0de-cbb0-48b4-9eea-20dea7e8f872): created successfully Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b23f605-893f-4488-9b1f-e521ca4421c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (70bd1228-19db-4c97-9578-86c9e23cdc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:47 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-cba29c57-87b6-4cf6-9842-f70f5e0b4a6f tempest-ProjectReaderTests-859995860 None] Created volume successfully. Sep 08 19:36:47 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b Sep 08 19:36:47 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:48 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b" returned: 0 in 0.483s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:48 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 Sep 08 19:36:48 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-fd46b0de-cbb0-48b4-9eea-20dea7e8f872-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "cinder-fd46b0de-cbb0-48b4-9eea-20dea7e8f872-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-quobyte-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" acquired by "delete_volume" :: waited 0.042s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1eeb03-7d79-4fe8-9b14-045d1014c99c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:48 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861" returned: 0 in 0.507s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:48 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861 Sep 08 19:36:48 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:48 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 Sep 08 19:36:48 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:48 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b.353af1e3-75b0-4a3c-8c53-2b3acc761861" returned: 0 in 0.333s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:48 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" returned: 0 in 0.475s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-353af1e3-75b0-4a3c-8c53-2b3acc761861" released by "_delete_snapshot" :: held 1.994s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:49 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872 Sep 08 19:36:49 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" released by "delete_snapshot" :: held 2.041s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Created reservations ['58c968d0-e34f-48e9-a12b-0c23eb066aef', 'ae2979ff-cded-459c-a1c7-cbae1d163079', '435e85ee-b8f3-4b4b-9e1f-408c36a1728c', '353caecb-f588-429e-8dee-ee831392e696'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Delete snapshot completed successfully. Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9a65ff01-37ee-4430-9de7-e7b02bda40c7 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-353af1e3-75b0-4a3c-8c53-2b3acc761861-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:49 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" returned: 0 in 0.361s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-fd46b0de-cbb0-48b4-9eea-20dea7e8f872" released by "delete_volume" :: held 0.926s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Created reservations ['c20c0068-083d-41f8-b112-c0915f020436', '73378621-1b5d-4b43-ae66-8a8d39fbfa46', '0099b7fa-fa8b-47c9-8715-5f5b3521d3d8', 'bb2910ed-6159-4ff9-93a0-0ed4305757fa'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:49 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:49 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (abf38dec-bb17-4f2c-bdd9-03372fef5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92666996-a45e-404c-b5de-c4ca643b3666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92666996-a45e-404c-b5de-c4ca643b3666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577061484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56b2547-89be-42ec-9bde-6a819c65af23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:50Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffb5e01-12e9-4ebe-b2da-c7092460b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ffb5e01-12e9-4ebe-b2da-c7092460b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30216a5-2d2a-4b9c-8b49-9773075842ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e30216a5-2d2a-4b9c-8b49-9773075842ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56b2547-89be-42ec-9bde-6a819c65af23', 'volume_name': 'volume-d56b2547-89be-42ec-9bde-6a819c65af23', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2b6be0-aa29-4aab-83d7-8b129cc1a43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2b6be0-aa29-4aab-83d7-8b129cc1a43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d0d3a-1904-450b-8bbc-f888dac021e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:49 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Volume d56b2547-89be-42ec-9bde-6a819c65af23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56b2547-89be-42ec-9bde-6a819c65af23', 'volume_size': 1} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-577061484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56b2547-89be-42ec-9bde-6a819c65af23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:50Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Creating volume d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:49 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:49 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 1073741824 Sep 08 19:36:49 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:49 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Deleted volume successfully. Sep 08 19:36:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-219bd9af-8023-4050-806b-5ecc9a5bbc0a tempest-ProjectReaderTests-859995860 None] Lock "cinder-fd46b0de-cbb0-48b4-9eea-20dea7e8f872-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:50 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 1073741824" returned: 0 in 0.476s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-08b07706-5796-4870-a461-2733be9bc49b-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-08b07706-5796-4870-a461-2733be9bc49b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:50 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 Sep 08 19:36:50 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2992bdac-a834-4510-918c-37ae0ff916b0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:50 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b Sep 08 19:36:50 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:50 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23" returned: 0 in 0.455s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661d0d3a-1904-450b-8bbc-f888dac021e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56b2547-89be-42ec-9bde-6a819c65af23', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2835a966-6736-4b1d-9735-d7b5a204b5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Volume volume-d56b2547-89be-42ec-9bde-6a819c65af23 (d56b2547-89be-42ec-9bde-6a819c65af23): created successfully Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2835a966-6736-4b1d-9735-d7b5a204b5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (abf38dec-bb17-4f2c-bdd9-03372fef5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f1192220-b79a-4484-84a8-254644f5638c tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:36:50 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b" returned: 0 in 0.449s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:50 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b Sep 08 19:36:50 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:51 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-08b07706-5796-4870-a461-2733be9bc49b" returned: 0 in 0.277s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-08b07706-5796-4870-a461-2733be9bc49b" released by "delete_volume" :: held 0.822s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (e670e35c-0685-4baf-985f-3838be64fa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecb1f6f-69e3-434d-ba42-50bb5449fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecb1f6f-69e3-434d-ba42-50bb5449fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278285798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597ea446-82d4-45ab-9526-82b69a4a3c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:51Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ac5d5a-b284-4544-8439-dff79b1d69fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ac5d5a-b284-4544-8439-dff79b1d69fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6858faa-50ee-40cc-8ca2-2fa0e3ba0efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6858faa-50ee-40cc-8ca2-2fa0e3ba0efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '597ea446-82d4-45ab-9526-82b69a4a3c42', 'volume_name': 'volume-597ea446-82d4-45ab-9526-82b69a4a3c42', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582b5afd-3193-4272-a8b3-f8ed7641d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (582b5afd-3193-4272-a8b3-f8ed7641d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410939b1-dddf-4c61-8b41-3c26136901c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:51 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Volume 597ea446-82d4-45ab-9526-82b69a4a3c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-597ea446-82d4-45ab-9526-82b69a4a3c42', 'volume_size': 1} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278285798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597ea446-82d4-45ab-9526-82b69a4a3c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d780e04f3345d5a75d315dfb4300f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:36:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:36:51Z,use_quota=True,user_id='b5cb6d075c0c4e6fb5ef6a75b124d01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Creating volume 597ea446-82d4-45ab-9526-82b69a4a3c42 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:51 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:51 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 1073741824 Sep 08 19:36:51 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Created reservations ['d8268189-9116-4fd6-b339-734ba7f26e86', '791339f8-bdbf-47de-90ca-9347c0ad4901', 'c44bb689-9b4c-4f1b-890a-47dc75c6a04d', '175931ea-432a-4e5f-ab0b-ba6910f093bf'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:51 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:51 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:51 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Deleted volume successfully. Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-e9c32519-62ca-4466-8249-135329af7142 tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-08b07706-5796-4870-a461-2733be9bc49b-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:51 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 1073741824" returned: 0 in 0.610s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:51 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 Sep 08 19:36:51 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:52 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42" returned: 0 in 0.296s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.052s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410939b1-dddf-4c61-8b41-3c26136901c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597ea446-82d4-45ab-9526-82b69a4a3c42', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef34bb1-ee24-4593-8628-06d6053c3ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot f9bc408c-018e-424f-8e0f-a0dab0bef757 of volume d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:36:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Volume volume-597ea446-82d4-45ab-9526-82b69a4a3c42 (597ea446-82d4-45ab-9526-82b69a4a3c42): created successfully Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef34bb1-ee24-4593-8628-06d6053c3ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Flow 'volume_create_manager' (e670e35c-0685-4baf-985f-3838be64fa71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[37621014-931a-4b54-95a5-490fd26a92c0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f021364e-dd2d-4328-be98-7402f172b6d8 tempest-ProjectReaderTests-859995860 None] Created volume successfully. Sep 08 19:36:52 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 Sep 08 19:36:52 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-d452a65c-3297-4b10-83ce-2c2f94e4152a-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-d452a65c-3297-4b10-83ce-2c2f94e4152a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "cinder-quobyte-d452a65c-3297-4b10-83ce-2c2f94e4152a" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-d452a65c-3297-4b10-83ce-2c2f94e4152a" acquired by "delete_volume" :: waited 0.030s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be216cb-fa13-4f57-b9ec-4230b65aeb77]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:52 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23" returned: 0 in 0.426s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:52 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a Sep 08 19:36:52 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 1G Sep 08 19:36:52 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:52 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:53 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a" returned: 0 in 0.538s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:53 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a Sep 08 19:36:53 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-597ea446-82d4-45ab-9526-82b69a4a3c42-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "cinder-597ea446-82d4-45ab-9526-82b69a4a3c42-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:53 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 1G" returned: 0 in 0.673s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56b2547-89be-42ec-9bde-6a819c65af23 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:53 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56b2547-89be-42ec-9bde-6a819c65af23 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 Sep 08 19:36:53 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Acquiring lock "cinder-quobyte-597ea446-82d4-45ab-9526-82b69a4a3c42" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-597ea446-82d4-45ab-9526-82b69a4a3c42" acquired by "delete_volume" :: waited 0.037s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f212da-3a48-4f5f-8225-dd64ae2b9196]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:53 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d452a65c-3297-4b10-83ce-2c2f94e4152a" returned: 0 in 0.360s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-quobyte-d452a65c-3297-4b10-83ce-2c2f94e4152a" released by "delete_volume" :: held 0.963s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Created reservations ['c894acda-85fa-46c0-9422-434c18e49583', '24741593-6b61-4a15-aebd-9d8884bd914c', '89480c16-eef3-48f1-8885-b0923c7dabff', '2d88900f-0b07-4f13-82e9-b8c5e924ab1b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:53 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 Sep 08 19:36:53 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:53 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56b2547-89be-42ec-9bde-6a819c65af23 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757" returned: 0 in 0.433s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:53 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 is being set with open permissions: ugo+rw Sep 08 19:36:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:53 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:53 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:53 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 Sep 08 19:36:53 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:54 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42" returned: 0 in 0.602s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:54 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.331s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:54 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42 Sep 08 19:36:54 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:54 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Deleted volume successfully. Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-80acdd2d-831e-43e5-b7cd-35dcbf66928d tempest-CinderUnicodeTest-1299086873 None] Lock "cinder-d452a65c-3297-4b10-83ce-2c2f94e4152a-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:54 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757" returned: 0 in 0.410s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:54 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info Sep 08 19:36:54 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:54 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-597ea446-82d4-45ab-9526-82b69a4a3c42" returned: 0 in 0.324s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "cinder-quobyte-597ea446-82d4-45ab-9526-82b69a4a3c42" released by "delete_volume" :: held 1.006s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Created reservations ['ce117656-34d8-45f0-ac82-414cb499673c', '02e60087-6593-4350-9aee-92be7da37fdc', '3d1f35ca-2a0e-4522-b379-040177b87091', '9bc6cba1-3474-404d-bb1b-6809f009ae5a'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:54 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:54 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:54 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info" returned: 0 in 0.404s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:54 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info is being set with open permissions: ugo+rw Sep 08 19:36:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:54 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info Sep 08 19:36:54 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:55 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.383s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:36:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Deleted volume successfully. Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f4d28e51-7084-46b1-8ce4-0757f4d721ce tempest-ProjectReaderTests-859995860 None] Lock "cinder-597ea446-82d4-45ab-9526-82b69a4a3c42-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:55 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.info" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b0955e70-6b48-4a79-b40a-5933c3653fb9 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-f9bc408c-018e-424f-8e0f-a0dab0bef757-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-f9bc408c-018e-424f-8e0f-a0dab0bef757-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-f9bc408c-018e-424f-8e0f-a0dab0bef757" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-f9bc408c-018e-424f-8e0f-a0dab0bef757" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot f9bc408c-018e-424f-8e0f-a0dab0bef757 of volume d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[728f0a41-53b5-459f-a7d3-4a5b1e6d7dac]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:55 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 Sep 08 19:36:55 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:56 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757" returned: 0 in 0.655s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56b2547-89be-42ec-9bde-6a819c65af23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e0d01-c5a8-455c-9bcc-e321dd41fe5e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:56 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 Sep 08 19:36:56 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:56 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23" returned: 0 in 0.440s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:56 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 Sep 08 19:36:56 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:57 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757" returned: 0 in 0.404s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:57 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757 Sep 08 19:36:57 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:57 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23.f9bc408c-018e-424f-8e0f-a0dab0bef757" returned: 0 in 0.306s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-f9bc408c-018e-424f-8e0f-a0dab0bef757" released by "_delete_snapshot" :: held 2.000s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" released by "delete_snapshot" :: held 2.032s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Created reservations ['f772f7e8-b4a7-4ef9-955c-33324cae6bbe', 'b04ff68e-74a6-496c-8b5e-7ed780b0720a', '4e60addb-2bb3-4415-a9dc-5e501fd9fff2', '1bb299aa-4450-40c9-b7b8-e172a260992c'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:57 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:36:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-46e876d0-a406-40b8-b158-cb1dbaa63712 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-f9bc408c-018e-424f-8e0f-a0dab0bef757-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-d56b2547-89be-42ec-9bde-6a819c65af23-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-d56b2547-89be-42ec-9bde-6a819c65af23-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479f3d0-98cf-450e-b1bb-6bcf668c06bf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:36:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:59 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 Sep 08 19:36:59 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:59 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23" returned: 0 in 0.411s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:59 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23 Sep 08 19:36:59 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:59 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d56b2547-89be-42ec-9bde-6a819c65af23" returned: 0 in 0.308s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-d56b2547-89be-42ec-9bde-6a819c65af23" released by "delete_volume" :: held 0.790s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Flow 'volume_create_manager' (aeb48705-02ba-40e3-ad80-9f5c6c6d0005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3e3f3b-f343-4f50-9e11-09df124bdb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Created reservations ['80662ec0-7dfb-44a0-b58d-b14d58f51545', '3805e515-523e-455a-b840-c1e1577491d1', '1c0d38da-92e0-4571-a39e-ed92b265b483', '52253e06-7a4c-4dfc-b2b4-7f68103ded34'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3e3f3b-f343-4f50-9e11-09df124bdb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-835081921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5003f3c3-3ba0-419e-855f-f55c60ba2e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687c77ff1f5486ea98b01393f14a448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:00Z,use_quota=True,user_id='b244f263877346549fcac92c368bd9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4e7c6-bddc-408b-b660-831924880aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d4e7c6-bddc-408b-b660-831924880aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09201677-2453-4391-8eab-6772296036e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09201677-2453-4391-8eab-6772296036e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5003f3c3-3ba0-419e-855f-f55c60ba2e54', 'volume_name': 'volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a545ab-0e33-4ed2-beb4-c622c001ddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a545ab-0e33-4ed2-beb4-c622c001ddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424483a7-94c3-4a4b-a155-44ecb02dd08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:36:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Volume 5003f3c3-3ba0-419e-855f-f55c60ba2e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54', 'volume_size': 1} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-835081921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5003f3c3-3ba0-419e-855f-f55c60ba2e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687c77ff1f5486ea98b01393f14a448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:00Z,use_quota=True,user_id='b244f263877346549fcac92c368bd9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Creating volume 5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:36:59 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:59 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 1073741824 Sep 08 19:36:59 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:36:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:36:59 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:36:59 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:00 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.316s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-232d4d01-f35a-4980-b1cd-c8a6fb7238c6 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-d56b2547-89be-42ec-9bde-6a819c65af23-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:00 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 1073741824" returned: 0 in 0.609s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:00 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:00 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (32616cce-c53e-4ecb-ae53-194744833a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9194b1d0-c119-41a8-ad7b-e877f89ba7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9194b1d0-c119-41a8-ad7b-e877f89ba7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178923608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f65b18d-019f-4f0f-84d2-ff4b234875bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:00Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf6d0a6-347e-4b66-bc03-533d03792a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cf6d0a6-347e-4b66-bc03-533d03792a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7f45f7-c600-4f35-957d-b1f62364cfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af7f45f7-c600-4f35-957d-b1f62364cfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f65b18d-019f-4f0f-84d2-ff4b234875bd', 'volume_name': 'volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfb4d5b-77e1-4d83-b182-2c29fca88a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfb4d5b-77e1-4d83-b182-2c29fca88a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f94a537-3793-4d7a-9fae-79ee451bb06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Volume 9f65b18d-019f-4f0f-84d2-ff4b234875bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd', 'volume_size': 1} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:00 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.095s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178923608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f65b18d-019f-4f0f-84d2-ff4b234875bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:00Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Creating volume 9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:00 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424483a7-94c3-4a4b-a155-44ecb02dd08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdde927-3c77-4039-a425-5af9bc570b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:00 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd 1073741824 Sep 08 19:37:00 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:00 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Volume volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 (5003f3c3-3ba0-419e-855f-f55c60ba2e54): created successfully Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cdde927-3c77-4039-a425-5af9bc570b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:00 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Flow 'volume_create_manager' (aeb48705-02ba-40e3-ad80-9f5c6c6d0005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:00 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2459a446-d2d9-4351-b29a-29d821cf3d4b tempest-SnapshotDependencyTests-2034499897 None] Created volume successfully. Sep 08 19:37:01 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd 1073741824" returned: 0 in 0.467s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:01 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd Sep 08 19:37:01 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:01 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f94a537-3793-4d7a-9fae-79ee451bb06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb1de59-b240-457d-9914-66fe67a7876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:01 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Volume volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd (9f65b18d-019f-4f0f-84d2-ff4b234875bd): created successfully Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb1de59-b240-457d-9914-66fe67a7876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:01 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (32616cce-c53e-4ecb-ae53-194744833a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:01 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-162ea3df-a4d4-4009-95f7-5c21d0470604 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Creating offline snapshot 23e462c3-04b4-4180-934a-5eb3f32c9869 of volume 5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd400fa7-7e4e-4901-b011-acfd5b586e72]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:02 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:02 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:02 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:02 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 1G Sep 08 19:37:02 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:02 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 1G" returned: 0 in 0.480s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:02 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:02 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:03 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.302s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:03 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 is being set with open permissions: ugo+rw Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:03 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:03 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:03 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.254s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:03 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info Sep 08 19:37:03 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:03 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:03 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info is being set with open permissions: ugo+rw Sep 08 19:37:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:03 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info Sep 08 19:37:03 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:04 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.info" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.317s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot eb6c6478-2ef0-4e93-b3d3-4df9061dae73 of volume 9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:04 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3df0825f-9ab7-4c25-a8a3-deb2a27a077c tempest-SnapshotDependencyTests-2034499897 None] Create snapshot completed successfully Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[098240e0-4245-42f1-9f5b-e3e32571054c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:04 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd Sep 08 19:37:04 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:04 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:04 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 1G Sep 08 19:37:04 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:04 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 1G" returned: 0 in 0.407s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:04 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 Sep 08 19:37:04 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:05 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73" returned: 0 in 0.322s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:05 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 is being set with open permissions: ugo+rw Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:05 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 Sep 08 19:37:05 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:05 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:05 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info Sep 08 19:37:05 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:05 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Flow 'volume_create_manager' (70758f8e-9ffe-439c-b0c3-7b100d7a9d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd75124-cd46-4835-a32a-51cfca350eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:05 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info is being set with open permissions: ugo+rw Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd75124-cd46-4835-a32a-51cfca350eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58cd429-5800-4573-96c0-68a58d310be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b687c77ff1f5486ea98b01393f14a448',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=23e462c3-04b4-4180-934a-5eb3f32c9869,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:06Z,use_quota=True,user_id='b244f263877346549fcac92c368bd9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:05 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info Sep 08 19:37:05 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8c1359-6a9a-46a7-b4bf-d6022853ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8c1359-6a9a-46a7-b4bf-d6022853ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3ac0d0-7122-4bfd-b9cb-96b053b81ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3ac0d0-7122-4bfd-b9cb-96b053b81ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c58cd429-5800-4573-96c0-68a58d310be8', 'volume_name': 'volume-c58cd429-5800-4573-96c0-68a58d310be8', 'volume_size': 1, 'snapshot_id': '23e462c3-04b4-4180-934a-5eb3f32c9869'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070fbbe0-b537-4bb2-afbb-f65c901dc5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070fbbe0-b537-4bb2-afbb-f65c901dc5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cd1d0-12d8-407b-ba21-10f9a9d60e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:05 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Volume c58cd429-5800-4573-96c0-68a58d310be8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c58cd429-5800-4573-96c0-68a58d310be8', 'volume_size': 1, 'snapshot_id': '23e462c3-04b4-4180-934a-5eb3f32c9869'} Sep 08 19:37:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:06 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.info" returned: 0 in 0.265s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.205s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869-c58cd429-5800-4573-96c0-68a58d310be8" by "_create_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869-c58cd429-5800-4573-96c0-68a58d310be8" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Creating volume c58cd429-5800-4573-96c0-68a58d310be8 from snapshot 23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" by "_copy_volume_from_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:06 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ca2f5057-95f8-4a55-b29a-be316c019ac1 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] snapshot: 23e462c3-04b4-4180-934a-5eb3f32c9869, volume: c58cd429-5800-4573-96c0-68a58d310be8, {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[15115729-7f2d-4b07-9274-7d3ba17039fa]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:06 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:06 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:06 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.396s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[408039ed-32b3-4950-80a5-2bdbf088964e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:06 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:06 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:06 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-eb6c6478-2ef0-4e93-b3d3-4df9061dae73-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-eb6c6478-2ef0-4e93-b3d3-4df9061dae73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-eb6c6478-2ef0-4e93-b3d3-4df9061dae73" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eb6c6478-2ef0-4e93-b3d3-4df9061dae73" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot eb6c6478-2ef0-4e93-b3d3-4df9061dae73 of volume 9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[39391def-8f3e-4c58-a6dc-6e2079d006e8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:07 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.445s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Creating direct copy from snapshot {{(pid=87521) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.utils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Path /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 not found in is_blk_device check {{(pid=87521) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:07 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 Sep 08 19:37:07 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:07 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 Sep 08 19:37:07 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:07 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73" returned: 0 in 0.391s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aad51a-5956-475e-9bd3-c1473cb109f8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:07 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:07 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd Sep 08 19:37:07 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:08 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd" returned: 0 in 0.696s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:08 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:08 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 Sep 08 19:37:08 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:09 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73" returned: 0 in 0.962s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:09 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73 Sep 08 19:37:09 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:09 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd.eb6c6478-2ef0-4e93-b3d3-4df9061dae73" returned: 0 in 0.588s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eb6c6478-2ef0-4e93-b3d3-4df9061dae73" released by "_delete_snapshot" :: held 2.832s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:09 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" released by "delete_snapshot" :: held 2.876s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Created reservations ['d0cd1c08-f800-45d0-8f00-8f9d94fefc3a', '60693411-054b-40b1-86ad-7b81addf355b', 'e6e98f5d-a6bc-48ba-9ef7-fbf37422c01d', '6d3b36a7-be7f-4090-8e07-3cea55622a75'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-bb28744e-da37-46e0-ad47-63a2a71d790b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-eb6c6478-2ef0-4e93-b3d3-4df9061dae73-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-9f65b18d-019f-4f0f-84d2-ff4b234875bd-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-9f65b18d-019f-4f0f-84d2-ff4b234875bd-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" acquired by "delete_volume" :: waited 0.031s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[101cb6fc-10f8-4dc7-80ea-0d2e659fab92]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:11 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd Sep 08 19:37:11 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:11 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd" returned: 0 in 0.805s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:11 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd Sep 08 19:37:11 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:12 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-9f65b18d-019f-4f0f-84d2-ff4b234875bd" returned: 0 in 0.529s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-9f65b18d-019f-4f0f-84d2-ff4b234875bd" released by "delete_volume" :: held 1.521s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Created reservations ['0dceb9fe-9083-4a76-aa13-416a6996330b', 'a44221d9-a729-4eba-9f6c-1cc62a9cfb59', '921b9865-723d-427d-b471-2f77b2e88159', '38d4e724-e3b0-4c12-802b-9ff6d61e2a55'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:12 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:12 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:12 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8" returned: 0 in 5.597s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.image.image_utils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Image conversion details: src /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 {{(pid=87521) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 08 19:37:12 devstack cinder-volume[87521]: INFO cinder.image.image_utils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Converted 1024.00 MB image at 182.92 MB/s Sep 08 19:37:12 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 is being set with open permissions: ugo+rw Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:12 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 Sep 08 19:37:12 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:12 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.300s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-ba1c6f97-c76c-4b78-9df5-12fc116ab05b tempest-ProjectMemberTests-2137510415 None] Lock "cinder-9f65b18d-019f-4f0f-84d2-ff4b234875bd-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:13 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8" returned: 0 in 0.300s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" released by "_copy_volume_from_snapshot" :: held 6.826s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869-c58cd429-5800-4573-96c0-68a58d310be8" released by "_create_volume_from_snapshot" :: held 6.902s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.926s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (826cd1d0-12d8-407b-ba21-10f9a9d60e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58cd429-5800-4573-96c0-68a58d310be8', 'volume_size': 1, 'snapshot_id': '23e462c3-04b4-4180-934a-5eb3f32c9869'}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54483112-3a7a-4f9a-b83e-419b7ab991eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Volume volume-c58cd429-5800-4573-96c0-68a58d310be8 (c58cd429-5800-4573-96c0-68a58d310be8): created successfully Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54483112-3a7a-4f9a-b83e-419b7ab991eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Flow 'volume_create_manager' (70758f8e-9ffe-439c-b0c3-7b100d7a9d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:13 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-12178cfa-43ce-4781-b01f-7b1c44615d8c tempest-SnapshotDependencyTests-2034499897 None] Created volume successfully. Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (f0114a59-ca72-4159-9504-871cd35de96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d149b67-cf34-48a5-b70e-f5153db6f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d149b67-cf34-48a5-b70e-f5153db6f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831423387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c6cee0-c23c-47e4-a253-c0857487abcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:13Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7e7af0-81ae-4249-b04b-e201277ac4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7e7af0-81ae-4249-b04b-e201277ac4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4430d84-5797-4a00-92fa-34f07a9283b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4430d84-5797-4a00-92fa-34f07a9283b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c6cee0-c23c-47e4-a253-c0857487abcf', 'volume_name': 'volume-57c6cee0-c23c-47e4-a253-c0857487abcf', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fc3fc3-5721-458e-aab8-41c8255690cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31fc3fc3-5721-458e-aab8-41c8255690cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fea78-87d9-445d-b314-1c26ae8511ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:13 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Volume 57c6cee0-c23c-47e4-a253-c0857487abcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c6cee0-c23c-47e4-a253-c0857487abcf', 'volume_size': 1} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1831423387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c6cee0-c23c-47e4-a253-c0857487abcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:13Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Creating volume 57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:13 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:13 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf 1073741824 Sep 08 19:37:13 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-23e462c3-04b4-4180-934a-5eb3f32c9869-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-23e462c3-04b4-4180-934a-5eb3f32c9869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Deleting offline snapshot 23e462c3-04b4-4180-934a-5eb3f32c9869 of volume 5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] snapshot_file for this snap is: volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c19b0d-225d-4a7e-a84d-4b2b4ad8b451]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:13 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf 1073741824" returned: 0 in 0.460s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:13 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:13 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:14 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf Sep 08 19:37:14 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:14 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf" returned: 0 in 0.262s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:14 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.374s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87fea78-87d9-445d-b314-1c26ae8511ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c6cee0-c23c-47e4-a253-c0857487abcf', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1469b005-dd5e-40b5-bd50-ed3ec0d6bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce3cb6-959d-45d9-86f7-70d58bdf4e8b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:14 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Volume volume-57c6cee0-c23c-47e4-a253-c0857487abcf (57c6cee0-c23c-47e4-a253-c0857487abcf): created successfully Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1469b005-dd5e-40b5-bd50-ed3ec0d6bf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (f0114a59-ca72-4159-9504-871cd35de96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-44dac564-563f-43e5-a960-cb6cb99e9fc7 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:14 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:14 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:14 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.558s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:14 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:14 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:15 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:15 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:15 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.382s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:15 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.265s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:15 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869 Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:15 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:37:15 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54.23e462c3-04b4-4180-934a-5eb3f32c9869" returned: 0 in 0.307s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-23e462c3-04b4-4180-934a-5eb3f32c9869" released by "_delete_snapshot" :: held 1.749s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" released by "delete_snapshot" :: held 1.775s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Created reservations ['2a2926ef-2d27-46e0-8fc6-a3601e34c741', '758664ef-b8be-4fef-9b39-5178d24927ee', 'a40e22b0-822e-4308-b331-46dfcbffa7a6', '133492d4-6f5f-49c2-b3e9-a1ea620f2267'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 4e55bed5-b9f3-4dfb-b9d1-741081f2d179 of volume 57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdc1848-229a-4423-a778-ef148ac5ed48]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Delete snapshot completed successfully. Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-35ceea30-129e-4617-8e6c-c38d32f49c03 tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-23e462c3-04b4-4180-934a-5eb3f32c9869-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:15 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf Sep 08 19:37:15 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-5003f3c3-3ba0-419e-855f-f55c60ba2e54-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-5003f3c3-3ba0-419e-855f-f55c60ba2e54-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" acquired by "delete_volume" :: waited 0.022s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f4f69f-32f0-4820-aa24-2dff75e2a948]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf" returned: 0 in 0.380s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 1G Sep 08 19:37:16 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:16 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:16 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:16 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.361s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54 Sep 08 19:37:16 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:16 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 1G" returned: 0 in 0.435s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c6cee0-c23c-47e4-a253-c0857487abcf -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c6cee0-c23c-47e4-a253-c0857487abcf -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 Sep 08 19:37:16 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:16 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-5003f3c3-3ba0-419e-855f-f55c60ba2e54" returned: 0 in 0.273s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-5003f3c3-3ba0-419e-855f-f55c60ba2e54" released by "delete_volume" :: held 0.707s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Created reservations ['b2318212-1b7b-4d6b-a981-a2d11046a9ca', 'c7593f21-4178-4059-adfd-bc52898e4599', 'b0bbf840-3cc1-4374-8ae0-841ba9568ccf', 'b72bf60c-1fe3-441d-86a3-fba4429ccd1f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:16 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:16 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57c6cee0-c23c-47e4-a253-c0857487abcf -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:16 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 is being set with open permissions: ugo+rw Sep 08 19:37:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:16 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 Sep 08 19:37:16 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:17 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.279s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Deleted volume successfully. Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-c58cd429-5800-4573-96c0-68a58d310be8-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c1a9504e-d83a-4881-ad21-38244dffbaeb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-5003f3c3-3ba0-419e-855f-f55c60ba2e54-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-c58cd429-5800-4573-96c0-68a58d310be8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:17 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179" returned: 0 in 0.331s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" acquired by "delete_volume" :: waited 0.023s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cc102-16db-4259-a5bd-1db6ee9a201c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:17 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info Sep 08 19:37:17 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:17 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 Sep 08 19:37:17 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:17 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:17 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info is being set with open permissions: ugo+rw Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:17 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info Sep 08 19:37:17 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:17 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8" returned: 0 in 0.415s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:17 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8 Sep 08 19:37:17 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:17 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.info" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-51d1cc85-dc57-460a-9a2b-1e43253b61ff tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:17 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-c58cd429-5800-4573-96c0-68a58d310be8" returned: 0 in 0.274s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-quobyte-c58cd429-5800-4573-96c0-68a58d310be8" released by "delete_volume" :: held 0.739s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Created reservations ['2b7c46f6-4144-4b1f-954b-7036970860df', '379a15b0-99fd-45eb-98c2-4d66de885ec2', 'f69310fc-9525-4a65-893e-1fe68d4926a6', 'd5575cf8-14d5-4e9e-91c2-c2be352ec211'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:18 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:18 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:18 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.289s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:18 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Deleted volume successfully. Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-88b0b674-76ca-4e78-a403-7f7957382bbb tempest-SnapshotDependencyTests-2034499897 None] Lock "cinder-c58cd429-5800-4573-96c0-68a58d310be8-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-4e55bed5-b9f3-4dfb-b9d1-741081f2d179-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-4e55bed5-b9f3-4dfb-b9d1-741081f2d179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-4e55bed5-b9f3-4dfb-b9d1-741081f2d179" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-4e55bed5-b9f3-4dfb-b9d1-741081f2d179" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 4e55bed5-b9f3-4dfb-b9d1-741081f2d179 of volume 57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a7e63-c903-47c2-b6ab-5d0c29b54fb2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:19 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 Sep 08 19:37:19 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:19 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179" returned: 0 in 0.443s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57c6cee0-c23c-47e4-a253-c0857487abcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[db67ff69-2dbd-4c30-8757-d8416bc0e4c1]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:19 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf Sep 08 19:37:19 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:19 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf" returned: 0 in 0.423s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:19 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 Sep 08 19:37:19 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:20 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179" returned: 0 in 0.438s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:20 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179 Sep 08 19:37:20 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:20 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf.4e55bed5-b9f3-4dfb-b9d1-741081f2d179" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-4e55bed5-b9f3-4dfb-b9d1-741081f2d179" released by "_delete_snapshot" :: held 1.710s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" released by "delete_snapshot" :: held 1.748s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Created reservations ['84a2541e-4ca8-479a-90bf-08e29b1826a6', '545ed25b-2b8f-4389-a804-296669760dc6', 'e248e484-7f70-4c39-96c0-1e6629b3110f', '721fffa5-8d5d-48a1-80fa-ea98ae3aa7d4'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:20 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:20 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d7cda1a4-1174-4973-a959-5b0ad1609c57 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-4e55bed5-b9f3-4dfb-b9d1-741081f2d179-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-57c6cee0-c23c-47e4-a253-c0857487abcf-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-57c6cee0-c23c-47e4-a253-c0857487abcf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" acquired by "delete_volume" :: waited 0.036s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5504962d-4660-404b-af49-928bac06b5f4]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:21 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf Sep 08 19:37:21 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:21 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf" returned: 0 in 0.432s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:21 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf Sep 08 19:37:21 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:21 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-57c6cee0-c23c-47e4-a253-c0857487abcf" returned: 0 in 0.261s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-57c6cee0-c23c-47e4-a253-c0857487abcf" released by "delete_volume" :: held 0.781s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Created reservations ['1d804faa-4965-465e-a47c-d4006257e079', 'bfe66edc-c8c7-4101-8a6c-18a83dda17d0', '307acf56-9398-4741-b400-ed12e6725b25', '787f5b23-6272-49ae-a1ca-18d03332a6f2'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:22 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:22 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:22 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-85ea99d9-bae1-4a48-b350-1a6b3c79eec1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-57c6cee0-c23c-47e4-a253-c0857487abcf-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (e1b0b394-f463-4e31-9e05-2273dfc9e1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:22 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a18bfc-9056-46d0-bcd3-f5c366d0d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a18bfc-9056-46d0-bcd3-f5c366d0d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230520696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1c6114-5b6d-4c7e-a50a-9e4be2877954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:23Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e355990-d61a-4509-bd37-ad3c668cf300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e355990-d61a-4509-bd37-ad3c668cf300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ebc06-ffe9-4b83-803e-3a570da28468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a36ebc06-ffe9-4b83-803e-3a570da28468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1c6114-5b6d-4c7e-a50a-9e4be2877954', 'volume_name': 'volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0868cc4-1078-438e-9758-29d9ce0212b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0868cc4-1078-438e-9758-29d9ce0212b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593b494-1f49-4916-a84b-dbc4171939c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Volume cd1c6114-5b6d-4c7e-a50a-9e4be2877954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954', 'volume_size': 1} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-230520696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd1c6114-5b6d-4c7e-a50a-9e4be2877954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:23Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Creating volume cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:23 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:23 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 1073741824 Sep 08 19:37:23 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:23 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 1073741824" returned: 0 in 0.591s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:23 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 Sep 08 19:37:23 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:24 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" returned: 0 in 0.322s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593b494-1f49-4916-a84b-dbc4171939c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ec5e5e-00c0-4617-87d4-9ac540798ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Volume volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 (cd1c6114-5b6d-4c7e-a50a-9e4be2877954): created successfully Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ec5e5e-00c0-4617-87d4-9ac540798ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (e1b0b394-f463-4e31-9e05-2273dfc9e1b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f3b0c781-b1f5-4ec4-b340-e4e2e3a564ce tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 735612c3-bb3d-4cdb-909f-dd28c72f82af of volume cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[68892314-eb16-4675-a47d-ea266dccf618]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:25 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 Sep 08 19:37:25 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:25 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" returned: 0 in 0.391s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:25 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af 1G Sep 08 19:37:25 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:25 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af 1G" returned: 0 in 0.415s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:26 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af Sep 08 19:37:26 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:26 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af" returned: 0 in 0.309s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:26 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af is being set with open permissions: ugo+rw Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:26 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af Sep 08 19:37:26 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:26 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af" returned: 0 in 0.259s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:26 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info Sep 08 19:37:26 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:26 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info" returned: 0 in 0.235s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:26 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info is being set with open permissions: ugo+rw Sep 08 19:37:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:26 devstack sudo[107987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info Sep 08 19:37:26 devstack sudo[107987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:27 devstack sudo[107987]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.info" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:27 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b81687a9-e8cb-4644-9a32-ccac78623ca2 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-735612c3-bb3d-4cdb-909f-dd28c72f82af-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-735612c3-bb3d-4cdb-909f-dd28c72f82af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-735612c3-bb3d-4cdb-909f-dd28c72f82af" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-735612c3-bb3d-4cdb-909f-dd28c72f82af" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 735612c3-bb3d-4cdb-909f-dd28c72f82af of volume cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[496dc23b-88e0-42ff-9712-5bee2cd711ad]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:27 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af Sep 08 19:37:27 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:27 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af" returned: 0 in 0.371s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0fe186-2606-4c5c-842b-80bf0e2f95b2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:27 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 Sep 08 19:37:27 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:28 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" returned: 0 in 0.386s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:28 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af Sep 08 19:37:28 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:28 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:28 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af Sep 08 19:37:28 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:28 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954.735612c3-bb3d-4cdb-909f-dd28c72f82af" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-735612c3-bb3d-4cdb-909f-dd28c72f82af" released by "_delete_snapshot" :: held 1.493s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" released by "delete_snapshot" :: held 1.522s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Created reservations ['6281421e-5aa8-4f17-9daa-f163608b1526', '101f292a-09e5-49f9-83a7-a86ea6671f91', '93a2445b-57f2-4610-8cae-f8b995904a02', '89698b28-d5a7-4073-8f18-4982cf77f91e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8be7a3fa-985a-4528-b155-4d9325b8b2de tempest-ProjectMemberTests-2137510415 None] Lock "cinder-735612c3-bb3d-4cdb-909f-dd28c72f82af-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-cd1c6114-5b6d-4c7e-a50a-9e4be2877954-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-cd1c6114-5b6d-4c7e-a50a-9e4be2877954-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" acquired by "delete_volume" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afe5ae9-3b53-403d-a4fd-8c9bcd9f2219]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:29 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 Sep 08 19:37:29 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:29 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" returned: 0 in 0.379s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:30 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954 Sep 08 19:37:30 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:30 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" returned: 0 in 0.263s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd1c6114-5b6d-4c7e-a50a-9e4be2877954" released by "delete_volume" :: held 0.711s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Created reservations ['939384aa-ceb1-43f8-b6b0-aa619937897b', '363d160b-9cb4-47ab-b1df-043ea999d3c7', '01f2940a-0e69-4ec3-b329-1f216e5da6d9', 'b1245e61-547f-4322-94d2-73279d719986'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:30 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:30 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:30 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:30 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:30 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b0c0d8f2-bb89-4810-ab6b-fe455490d25a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-cd1c6114-5b6d-4c7e-a50a-9e4be2877954-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (60c1e13b-4c9b-4f56-98c8-513d17577adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9707876d-b4d0-430a-aafe-1ae8eda524f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9707876d-b4d0-430a-aafe-1ae8eda524f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926486750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b081caf0-6f3c-48bc-a547-98ae06f5c441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:31Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcf4ac5-54ba-4c61-a8ff-2d7e9f144b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcf4ac5-54ba-4c61-a8ff-2d7e9f144b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7dd704-1efa-4d19-a44b-90b2ce223ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef7dd704-1efa-4d19-a44b-90b2ce223ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b081caf0-6f3c-48bc-a547-98ae06f5c441', 'volume_name': 'volume-b081caf0-6f3c-48bc-a547-98ae06f5c441', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84189ff5-a47a-4f96-97d5-c4806f93f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84189ff5-a47a-4f96-97d5-c4806f93f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74a8bac-8e0f-4c70-bd1c-a07575b93387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Volume b081caf0-6f3c-48bc-a547-98ae06f5c441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b081caf0-6f3c-48bc-a547-98ae06f5c441', 'volume_size': 1} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-926486750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b081caf0-6f3c-48bc-a547-98ae06f5c441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:31Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Creating volume b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:31 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:31 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 1073741824 Sep 08 19:37:31 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:31 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 1073741824" returned: 0 in 0.409s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:31 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 Sep 08 19:37:31 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:31 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e74a8bac-8e0f-4c70-bd1c-a07575b93387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b081caf0-6f3c-48bc-a547-98ae06f5c441', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61da4a-326a-4d1d-9ae7-49e632f9b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Volume volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 (b081caf0-6f3c-48bc-a547-98ae06f5c441): created successfully Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c61da4a-326a-4d1d-9ae7-49e632f9b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (60c1e13b-4c9b-4f56-98c8-513d17577adb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9782c184-81bc-4c9a-b759-7b923d629879 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 5e207f74-149d-4b82-aaf1-30ffbc1f2f36 of volume b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f329f2f-4885-435e-b556-1498e6f17c44]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:32 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 Sep 08 19:37:32 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:32 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:32 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 1G Sep 08 19:37:32 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:32 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 1G" returned: 0 in 0.376s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:33 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 Sep 08 19:37:33 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:33 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36" returned: 0 in 0.292s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:33 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 is being set with open permissions: ugo+rw Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:33 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 Sep 08 19:37:33 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:33 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:33 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info Sep 08 19:37:33 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:33 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:33 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info is being set with open permissions: ugo+rw Sep 08 19:37:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:33 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info Sep 08 19:37:33 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:34 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.info" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:34 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d21cb06d-f918-44f9-bef5-9597dfec83c3 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-5e207f74-149d-4b82-aaf1-30ffbc1f2f36-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-5e207f74-149d-4b82-aaf1-30ffbc1f2f36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-5e207f74-149d-4b82-aaf1-30ffbc1f2f36" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-5e207f74-149d-4b82-aaf1-30ffbc1f2f36" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 5e207f74-149d-4b82-aaf1-30ffbc1f2f36 of volume b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f7e71-e6e6-4bcc-a07e-8f301111cef7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:34 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 Sep 08 19:37:34 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:34 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b081caf0-6f3c-48bc-a547-98ae06f5c441(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43e548-5135-449e-a78f-17acf7e9806a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:34 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 Sep 08 19:37:34 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:35 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441" returned: 0 in 0.360s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:35 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 Sep 08 19:37:35 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:35 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36" returned: 0 in 0.341s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:35 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36 Sep 08 19:37:35 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:35 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441.5e207f74-149d-4b82-aaf1-30ffbc1f2f36" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-5e207f74-149d-4b82-aaf1-30ffbc1f2f36" released by "_delete_snapshot" :: held 1.380s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" released by "delete_snapshot" :: held 1.404s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Created reservations ['6c964585-ca1f-4d56-a11a-6b85bb83cd03', '60020f53-945d-45e6-bdeb-52a528c4f51c', '17be3c6d-5950-4618-8ea4-268c7c591762', 'edfcd1ad-39e9-4cd3-8433-e78f26238464'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b67b13c0-35ff-4e95-9f72-7ebe5888f2d1 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-5e207f74-149d-4b82-aaf1-30ffbc1f2f36-delete_snapshot" released by "delete_snapshot" :: held 1.538s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-b081caf0-6f3c-48bc-a547-98ae06f5c441-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-b081caf0-6f3c-48bc-a547-98ae06f5c441-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f4baa9-9de9-416b-bb1a-d97ab14e4b13]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:36 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 Sep 08 19:37:36 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:36 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:36 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441 Sep 08 19:37:36 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:37 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b081caf0-6f3c-48bc-a547-98ae06f5c441" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-b081caf0-6f3c-48bc-a547-98ae06f5c441" released by "delete_volume" :: held 0.646s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Created reservations ['226bcacf-ee96-46df-9e4e-f255b5d39d85', 'ac742683-7dd2-4fde-9e26-8d7c790dfcd6', '3dcb3921-c854-4121-80d9-209abbb4d721', '7f6b779e-adab-4a21-8b8e-d3b3d5465e4f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:37 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:37 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:37 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:37 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:37 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a29c1b29-361a-4293-a2ce-1df2247b9e50 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-b081caf0-6f3c-48bc-a547-98ae06f5c441-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (b9800c29-9c8f-41f0-84d9-ea3901179145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca5295e-f6d5-47a2-a197-62e8aa1e7bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cca5295e-f6d5-47a2-a197-62e8aa1e7bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74683644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:38Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3289b48-9084-4a33-9566-4bf8dbed29ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3289b48-9084-4a33-9566-4bf8dbed29ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7ca5c7-2b91-418e-b2f4-421dddda2eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f7ca5c7-2b91-418e-b2f4-421dddda2eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff', 'volume_name': 'volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72cb9df-ec09-467d-8abf-a5633f55d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72cb9df-ec09-467d-8abf-a5633f55d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f2d50-c0aa-47f6-84c3-41a68bb7c81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Volume eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff', 'volume_size': 1} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-74683644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:38Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Creating volume eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:38 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:38 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff 1073741824 Sep 08 19:37:38 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:38 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff 1073741824" returned: 0 in 0.396s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:38 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff Sep 08 19:37:38 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:38 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f2d50-c0aa-47f6-84c3-41a68bb7c81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dc39be-7a8e-4880-aea2-855cc6861e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Volume volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff (eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff): created successfully Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3dc39be-7a8e-4880-aea2-855cc6861e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (b9800c29-9c8f-41f0-84d9-ea3901179145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9dec4f93-6211-4094-ac4b-2dd56f21cdbb tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 of volume eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d42bf6-0708-4693-b40d-eb49456c9e7c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:39 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff Sep 08 19:37:39 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:39 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:39 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 1G Sep 08 19:37:39 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:39 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 1G" returned: 0 in 0.380s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:39 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 Sep 08 19:37:39 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:40 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" returned: 0 in 0.291s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:40 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 is being set with open permissions: ugo+rw Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:40 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 Sep 08 19:37:40 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:40 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" returned: 0 in 0.231s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:40 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info Sep 08 19:37:40 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:40 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:40 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info is being set with open permissions: ugo+rw Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:40 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info Sep 08 19:37:40 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:40 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.info" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.792s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:41 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d16bb974-560b-44e0-a4b1-4b817839593e tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 of volume eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5011ec7d-98ee-497f-b55d-660f8caf9b35]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:41 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 Sep 08 19:37:41 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:41 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[26202468-743b-4c9c-bb50-b2e2063cbdc0]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:41 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff Sep 08 19:37:41 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:42 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" returned: 0 in 0.365s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:42 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 Sep 08 19:37:42 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:42 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:42 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1 Sep 08 19:37:42 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:42 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff.0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1" released by "_delete_snapshot" :: held 1.354s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" released by "delete_snapshot" :: held 1.374s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Created reservations ['a58db8a2-be35-4073-9e49-e804fca54ae2', '3d908597-0b96-4971-89eb-dc1403699fbc', '777d0d99-5f88-488f-b831-87b02a6d8830', '0ae8c2a0-b7d1-4661-a2e0-36467940b1e5'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a39a91e1-d3b0-4581-9933-7246e178187a tempest-ProjectMemberTests-2137510415 None] Lock "cinder-0c12df0a-ec22-45c2-944c-c21fc9fa8fc1-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "cinder-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" acquired by "delete_volume" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[945aa403-812d-4606-898d-fdf786dd2a2c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:43 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff Sep 08 19:37:43 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:43 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:43 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff Sep 08 19:37:43 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:44 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff" released by "delete_volume" :: held 0.633s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Created reservations ['955fb9bd-8566-45f4-84dc-73c5ea6eda87', '6b6ed3c6-e75e-4da5-9f5f-80b28d707cbf', '08523e0f-7809-43ee-8643-f457306dd75b', '4348b0ad-b125-4952-9d43-aca9a94046fe'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:44 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:44 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:44 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:44 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:44 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-d547a26c-73a3-4e4b-b6a2-d39fe5e5435e tempest-ProjectMemberTests-2137510415 None] Lock "cinder-eaa4b13d-8d68-4fd9-b1e3-8efbe2ba13ff-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (8d4bc195-0bb9-485c-8006-16ec7e1b27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161364fa-cc56-4039-92b6-2cd9cc6deec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (161364fa-cc56-4039-92b6-2cd9cc6deec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327719829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37e1de-ddd7-4b42-bac8-d2f5c90311dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:45Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9218339-4ab0-4a56-a486-41fb6dbdf390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9218339-4ab0-4a56-a486-41fb6dbdf390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ebb21b-e9bf-41cc-8a1d-701fa5e63c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ebb21b-e9bf-41cc-8a1d-701fa5e63c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac37e1de-ddd7-4b42-bac8-d2f5c90311dc', 'volume_name': 'volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212ae5b0-b141-4176-b3f6-1a2a76fb6e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (212ae5b0-b141-4176-b3f6-1a2a76fb6e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f66917-6427-4913-9692-bd92a0ac9d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Volume ac37e1de-ddd7-4b42-bac8-d2f5c90311dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc', 'volume_size': 1} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327719829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac37e1de-ddd7-4b42-bac8-d2f5c90311dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:45Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Creating volume ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:45 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:45 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc 1073741824 Sep 08 19:37:45 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:45 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc 1073741824" returned: 0 in 0.432s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:45 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc Sep 08 19:37:45 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:45 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49f66917-6427-4913-9692-bd92a0ac9d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2423de0-ed00-4833-bcdc-76445930c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:45 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Volume volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc (ac37e1de-ddd7-4b42-bac8-d2f5c90311dc): created successfully Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2423de0-ed00-4833-bcdc-76445930c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:45 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (8d4bc195-0bb9-485c-8006-16ec7e1b27ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:45 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-584ccf02-608d-4ee5-9768-d54ee293a439 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 5392248f-4abf-4fcc-82ba-c27904638473 of volume ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c33a9-f2d7-466e-9a6b-a77cd366c666]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:46 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc Sep 08 19:37:46 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:46 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:46 devstack sudo[108200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 1G Sep 08 19:37:46 devstack sudo[108200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:46 devstack sudo[108200]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 1G" returned: 0 in 0.380s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:46 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:46 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 Sep 08 19:37:46 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:47 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473" returned: 0 in 0.298s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:47 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 is being set with open permissions: ugo+rw Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:47 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 Sep 08 19:37:47 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:47 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=185,cinder:DELETE=12,cinder:SELECT=158,cinder:INSERT=47 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:47 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info Sep 08 19:37:47 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:47 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:47 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info is being set with open permissions: ugo+rw Sep 08 19:37:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:47 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info Sep 08 19:37:47 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:48 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.info" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=129,cinder:INSERT=51,cinder:UPDATE=180,cinder:DELETE=18 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:37:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-dd888b22-9b34-4d9f-ba88-bd639343887d tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-5392248f-4abf-4fcc-82ba-c27904638473-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-5392248f-4abf-4fcc-82ba-c27904638473-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-5392248f-4abf-4fcc-82ba-c27904638473" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-5392248f-4abf-4fcc-82ba-c27904638473" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 5392248f-4abf-4fcc-82ba-c27904638473 of volume ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84e1580-a10d-46de-b5f6-3ee72dbc0392]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:48 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 Sep 08 19:37:48 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:48 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473" returned: 0 in 0.348s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e47d5b-1ad9-4f33-a0e5-ae611b113b71]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:48 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc Sep 08 19:37:48 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:49 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" returned: 0 in 0.367s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:49 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 Sep 08 19:37:49 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:49 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473" returned: 0 in 0.328s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:49 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473 Sep 08 19:37:49 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:49 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc.5392248f-4abf-4fcc-82ba-c27904638473" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-5392248f-4abf-4fcc-82ba-c27904638473" released by "_delete_snapshot" :: held 1.364s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" released by "delete_snapshot" :: held 1.386s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Created reservations ['2c722d5d-6f3e-4f11-8b4b-ecaa1e1146b5', '06710ff6-597e-4905-b4ee-cd6c87af76f9', '2b908774-9fc3-49d9-b88d-3030da95ef04', 'a0b2e325-15ae-40f6-ad51-485d95001446'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-b24eb0df-be7a-4aa4-9c21-3889a89dc400 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-5392248f-4abf-4fcc-82ba-c27904638473-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9151b-23a8-4cc4-97b0-84f05a6e04c5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:50 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc Sep 08 19:37:50 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:50 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" returned: 0 in 0.347s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:50 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc Sep 08 19:37:50 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:51 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc" released by "delete_volume" :: held 0.645s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Created reservations ['e5aacb94-1d34-4452-b404-150e0b457869', 'fc620f9b-dff6-4a0c-90d9-923438e63839', 'd1493879-e7ec-4991-be35-a086437149cb', '05b4cd7c-2275-42da-bbd9-1af959e21b35'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:51 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:51 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:51 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:51 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a5e7611a-020c-4167-88f5-7749bc532a48 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-ac37e1de-ddd7-4b42-bac8-d2f5c90311dc-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (c3ffd336-b00f-4e64-bef0-5e893d177ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e704393e-0bbb-4824-8cab-060cf50a072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e704393e-0bbb-4824-8cab-060cf50a072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856693283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30eed11-bcd9-4dd7-8cb3-e9b902a326a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:52Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e6c3c1-8128-4536-be35-9114f94fd3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e6c3c1-8128-4536-be35-9114f94fd3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167f9a9b-9807-4810-aac4-91c6c58b6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167f9a9b-9807-4810-aac4-91c6c58b6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30eed11-bcd9-4dd7-8cb3-e9b902a326a1', 'volume_name': 'volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2ed0ee-26f4-4357-97b5-a9f6a13827bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae2ed0ee-26f4-4357-97b5-a9f6a13827bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ca8b3d-9e00-4f20-a5fd-fb86b7ab650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Volume e30eed11-bcd9-4dd7-8cb3-e9b902a326a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1', 'volume_size': 1} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1856693283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30eed11-bcd9-4dd7-8cb3-e9b902a326a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:52Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Creating volume e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:52 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:52 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 1073741824 Sep 08 19:37:52 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:52 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 1073741824" returned: 0 in 0.395s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:52 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 Sep 08 19:37:52 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:52 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" returned: 0 in 0.234s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ca8b3d-9e00-4f20-a5fd-fb86b7ab650f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d503f8-74e4-4df0-b77f-c7a5b22cac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:52 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Volume volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 (e30eed11-bcd9-4dd7-8cb3-e9b902a326a1): created successfully Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2d503f8-74e4-4df0-b77f-c7a5b22cac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:52 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (c3ffd336-b00f-4e64-bef0-5e893d177ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-487d4eb6-9c5c-4d80-95ac-b1e004415b14 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 of volume e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[08858da0-a3d8-4d7f-8b88-9d1bd7c6ab08]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:53 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 Sep 08 19:37:53 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:53 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" returned: 0 in 0.349s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:53 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 1G Sep 08 19:37:53 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:53 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 1G" returned: 0 in 0.377s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:53 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:54 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 Sep 08 19:37:54 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:54 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" returned: 0 in 0.288s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:54 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 is being set with open permissions: ugo+rw Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:54 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 Sep 08 19:37:54 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:54 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:54 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info Sep 08 19:37:54 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:54 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:54 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info is being set with open permissions: ugo+rw Sep 08 19:37:54 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:54 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info Sep 08 19:37:54 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:55 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.info" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:55 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-60a1df52-2f58-4bfd-b96a-45ab4e3d9ff4 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 of volume e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[00998f65-005d-40a0-ac85-ad3a57dbd3ed]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:55 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 Sep 08 19:37:55 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:55 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" returned: 0 in 0.362s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ede975e-d1ed-4bad-bf4c-797229ab83f8]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:55 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:55 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 Sep 08 19:37:55 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:56 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:56 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 Sep 08 19:37:56 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:56 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" returned: 0 in 0.325s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:56 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4 Sep 08 19:37:56 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:56 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1.cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4" released by "_delete_snapshot" :: held 1.365s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" released by "delete_snapshot" :: held 1.385s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Created reservations ['1bb33705-40b7-450a-8219-01cdc47a7668', '0a585308-f73b-403f-bda7-4f36c4f2fd6a', '627a376b-a906-4f26-80da-8741378221f8', 'ba011d0c-8e83-4bb7-bc4e-46654b46d377'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:56 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:37:56 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-aa0b887c-3d75-4aed-9e8b-7c9e81b94640 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-cd8b1d52-2e78-4c82-a960-4ff6aa09c4c4-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[671ec2e5-5ed5-4604-8a88-707a21781911]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:57 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 Sep 08 19:37:57 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:57 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" returned: 0 in 0.362s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:57 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:58 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1 Sep 08 19:37:58 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:58 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" returned: 0 in 0.250s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1" released by "delete_volume" :: held 0.661s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Created reservations ['e35e23c4-7ff1-4f46-a96f-d1a746d07583', '3db3dda3-7875-4630-8df5-5d5b6af5fca5', '8cf2372a-8deb-4059-a397-0046ee1e0fff', '180c6bc3-d3c3-4c21-a0e2-bb8a9ab3ef0b'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:58 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:37:58 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:58 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:37:58 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:37:58 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a025e23d-b7d5-4d97-8b69-3dbd851afb90 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-e30eed11-bcd9-4dd7-8cb3-e9b902a326a1-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (78955575-877a-46f2-bab5-5d99075cac25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fcee96-2de8-4f49-989a-4cc8d3201608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fcee96-2de8-4f49-989a-4cc8d3201608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923933789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:59Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb58ce73-a164-4632-8d9e-0ed849d18504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb58ce73-a164-4632-8d9e-0ed849d18504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bca1a5-bb41-4764-8b06-99b4650cc3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77bca1a5-bb41-4764-8b06-99b4650cc3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee', 'volume_name': 'volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee0bd33-fcd6-40f2-b0b6-f18c300f1e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee0bd33-fcd6-40f2-b0b6-f18c300f1e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6febc28-7aec-49d0-a707-3eb88b04846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Volume daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee', 'volume_size': 1} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923933789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0f477ffd70f4b5fbf16ba5ffe44d830',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:37:59Z,use_quota=True,user_id='2073ec1408d44d50b1b04e8b37f70fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Creating volume daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:37:59 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:59 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee 1073741824 Sep 08 19:37:59 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:59 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee 1073741824" returned: 0 in 0.420s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:37:59 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee Sep 08 19:37:59 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:37:59 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" returned: 0 in 0.230s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6febc28-7aec-49d0-a707-3eb88b04846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c9f63-8fdf-4216-8c86-693a87b4b06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:37:59 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Volume volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee (daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee): created successfully Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7c9f63-8fdf-4216-8c86-693a87b4b06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:37:59 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Flow 'volume_create_manager' (78955575-877a-46f2-bab5-5d99075cac25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:37:59 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-94e79b2f-2f1a-451b-a6cd-33ce6a18a1c7 tempest-ProjectMemberTests-2137510415 None] Created volume successfully. Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Creating offline snapshot 4053b8ed-5258-41b7-a94b-c5f34f03432e of volume daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[47541a45-3b8f-46a0-97ee-20e79a6b00c6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:00 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee Sep 08 19:38:00 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:00 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:00 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:00 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e 1G Sep 08 19:38:00 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:01 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e 1G" returned: 0 in 0.373s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:01 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e Sep 08 19:38:01 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:01 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e" returned: 0 in 0.286s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:01 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e is being set with open permissions: ugo+rw Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:01 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e Sep 08 19:38:01 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:01 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:01 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info Sep 08 19:38:01 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:01 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:01 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info is being set with open permissions: ugo+rw Sep 08 19:38:01 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:01 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info Sep 08 19:38:01 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:02 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.info" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:02 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1da17398-90c6-4c88-a1a7-eafc027670a0 tempest-ProjectMemberTests-2137510415 None] Create snapshot completed successfully Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-4053b8ed-5258-41b7-a94b-c5f34f03432e-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-4053b8ed-5258-41b7-a94b-c5f34f03432e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-4053b8ed-5258-41b7-a94b-c5f34f03432e" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-4053b8ed-5258-41b7-a94b-c5f34f03432e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Deleting offline snapshot 4053b8ed-5258-41b7-a94b-c5f34f03432e of volume daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] snapshot_file for this snap is: volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70d3ec4-3107-4b56-bd36-d9aef3e7a3f2]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:02 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e Sep 08 19:38:02 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:02 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f61a4f-76f1-478c-ac3a-5856e4b1874a]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:02 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:03 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee Sep 08 19:38:03 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:03 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:03 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e Sep 08 19:38:03 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:03 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e" returned: 0 in 0.316s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:03 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e Sep 08 19:38:03 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:03 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee.4053b8ed-5258-41b7-a94b-c5f34f03432e" returned: 0 in 0.234s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-4053b8ed-5258-41b7-a94b-c5f34f03432e" released by "_delete_snapshot" :: held 1.320s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" released by "delete_snapshot" :: held 1.344s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Created reservations ['44b90028-bc69-49f3-b010-a7d1a220f132', '3ac334ec-0d01-4e0e-b145-b6820ce388f4', '0dc6e9a6-9855-40d2-a870-53756565cc63', 'e0b4e9f2-a776-4d24-8b35-3d19a1dd05ab'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:03 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Delete snapshot completed successfully. Sep 08 19:38:03 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-28fb9e4d-1b7e-401e-91dc-30610d01afea tempest-ProjectMemberTests-2137510415 None] Lock "cinder-4053b8ed-5258-41b7-a94b-c5f34f03432e-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d84eb02-c67c-4a5a-95ac-59175fa2a532]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:04 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:04 devstack sudo[108376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee Sep 08 19:38:04 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:05 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" returned: 0 in 0.346s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:05 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee Sep 08 19:38:05 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:05 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" returned: 0 in 0.233s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-quobyte-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee" released by "delete_volume" :: held 0.630s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Created reservations ['23cf93cf-4a5a-4d74-a04c-df33e149f96d', '7e5ef36b-8a7a-4e86-a739-a67e2faef1bd', '688f292e-31f6-4ff7-80e2-470b99254680', 'e42f0e8a-f5ce-4dc3-9e31-33a6dfd71400'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:05 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:05 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:05 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:05 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Deleted volume successfully. Sep 08 19:38:05 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-c4b5d94c-a572-4775-950d-a58bdc0d59f9 tempest-ProjectMemberTests-2137510415 None] Lock "cinder-daad1cb2-c49e-49b9-8e9f-dbd6b59a08ee-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (bae1134f-d585-4841-9c72-5c992533e24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c930636-d294-4657-aa16-dfc033d5b455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c930636-d294-4657-aa16-dfc033d5b455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531442746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0510a1-035f-4e8d-992a-916f2ec5216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:09Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceee694-7895-4be5-b8ff-a046243f0c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ceee694-7895-4be5-b8ff-a046243f0c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f4b1a4-6fcd-476c-9982-2860c52c543d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f4b1a4-6fcd-476c-9982-2860c52c543d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da0510a1-035f-4e8d-992a-916f2ec5216c', 'volume_name': 'volume-da0510a1-035f-4e8d-992a-916f2ec5216c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a372d9ae-dc0e-404b-9547-79ecb7be77c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a372d9ae-dc0e-404b-9547-79ecb7be77c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0ddeee-1bc3-407f-87ac-2d6596994140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Volume da0510a1-035f-4e8d-992a-916f2ec5216c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da0510a1-035f-4e8d-992a-916f2ec5216c', 'volume_size': 1} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1531442746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da0510a1-035f-4e8d-992a-916f2ec5216c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:09Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Creating volume da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:09 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:09 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c 1073741824 Sep 08 19:38:09 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:09 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c 1073741824" returned: 0 in 0.399s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:09 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c Sep 08 19:38:09 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:09 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0ddeee-1bc3-407f-87ac-2d6596994140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da0510a1-035f-4e8d-992a-916f2ec5216c', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d980039-f99a-4439-962e-40ae5caee957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:09 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Volume volume-da0510a1-035f-4e8d-992a-916f2ec5216c (da0510a1-035f-4e8d-992a-916f2ec5216c): created successfully Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d980039-f99a-4439-962e-40ae5caee957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:09 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (bae1134f-d585-4841-9c72-5c992533e24e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:10 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9bd80295-aebe-447e-a60b-a5b3a67cfdc3 tempest-ProjectReaderTests-1185144345 None] Created volume successfully. Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Creating offline snapshot fbb56d13-d32d-4829-bba7-815d8263a83d of volume da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[761bc346-631d-4df2-87b8-2c63c854d624]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:10 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c Sep 08 19:38:10 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:10 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c" returned: 0 in 0.349s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:10 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:10 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d 1G Sep 08 19:38:10 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:11 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d 1G" returned: 0 in 0.385s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0510a1-035f-4e8d-992a-916f2ec5216c -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:11 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0510a1-035f-4e8d-992a-916f2ec5216c -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d Sep 08 19:38:11 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:11 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da0510a1-035f-4e8d-992a-916f2ec5216c -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:11 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d is being set with open permissions: ugo+rw Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:11 devstack sudo[108412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d Sep 08 19:38:11 devstack sudo[108412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:11 devstack sudo[108412]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d" returned: 0 in 0.235s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:11 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info Sep 08 19:38:11 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:11 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:11 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info is being set with open permissions: ugo+rw Sep 08 19:38:11 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:11 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info Sep 08 19:38:11 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:12 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.info" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:12 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fbd40518-20f3-4f55-b9df-27095b55a63b tempest-ProjectReaderTests-1185144345 None] Create snapshot completed successfully Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-fbb56d13-d32d-4829-bba7-815d8263a83d-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-fbb56d13-d32d-4829-bba7-815d8263a83d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-fbb56d13-d32d-4829-bba7-815d8263a83d" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-fbb56d13-d32d-4829-bba7-815d8263a83d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Deleting offline snapshot fbb56d13-d32d-4829-bba7-815d8263a83d of volume da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] snapshot_file for this snap is: volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c142b2-7ae9-4b84-b876-519c7e611b12]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:12 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:12 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d Sep 08 19:38:12 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:13 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d" returned: 0 in 0.338s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da0510a1-035f-4e8d-992a-916f2ec5216c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a003426c-31f6-47ee-9b75-25b7f06021c3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:13 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c Sep 08 19:38:13 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:13 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:13 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d Sep 08 19:38:13 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:13 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d" returned: 0 in 0.327s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:13 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d Sep 08 19:38:13 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:13 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c.fbb56d13-d32d-4829-bba7-815d8263a83d" returned: 0 in 0.257s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-fbb56d13-d32d-4829-bba7-815d8263a83d" released by "_delete_snapshot" :: held 1.352s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:13 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" released by "delete_snapshot" :: held 1.372s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Created reservations ['29c6e781-bf2b-44a3-bace-88b7bf0317ee', '74a388ac-13a5-4a9c-a731-b36d4c9869e6', 'fce33f49-cb77-470e-a236-a6277a7b1d0c', '9f07450f-0f03-491e-94c6-f16030cc43da'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:14 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Delete snapshot completed successfully. Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-f6742816-9637-410a-9359-3d35687420fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-fbb56d13-d32d-4829-bba7-815d8263a83d-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-da0510a1-035f-4e8d-992a-916f2ec5216c-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-da0510a1-035f-4e8d-992a-916f2ec5216c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" acquired by "delete_volume" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b214b6e5-69d4-42c0-b22a-b801723fa7b3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:14 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c Sep 08 19:38:14 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:14 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:15 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:15 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:15 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c" returned: 0 in 0.360s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:15 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c Sep 08 19:38:15 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:15 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_service.periodic_task [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] Running periodic task VolumeManager._thread_info {{(pid=87521) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread count: 29 {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-f9fedf58-49f6-4980-834d-196dec441e86 None None] thread info: [<_MainThread(MainThread, started 132112506404992)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87521) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 08 19:38:15 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-da0510a1-035f-4e8d-992a-916f2ec5216c" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-da0510a1-035f-4e8d-992a-916f2ec5216c" released by "delete_volume" :: held 0.655s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Created reservations ['7d31dd44-bb01-4ef2-9bff-dcd54c42d72d', 'd3a7bd03-4dac-44d0-a4d2-252097ad3ea7', '22e8ed87-4474-45b2-99fb-9a169f6cceeb', 'bb58e23c-85ec-4619-b663-794ddc3a7258'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:15 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:15 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:15 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:15 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Deleted volume successfully. Sep 08 19:38:15 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-3cc7f006-2d6a-4f04-8a93-f2d4ea9ff976 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-da0510a1-035f-4e8d-992a-916f2ec5216c-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (5087e890-d3bd-47d0-98b8-9d193367f453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f4c2a0-e08d-4c9d-b8d0-89f5ddbeda91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f4c2a0-e08d-4c9d-b8d0-89f5ddbeda91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417904682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:16Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cb43f-9e71-4522-beb5-c743ed12b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cb43f-9e71-4522-beb5-c743ed12b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525544b-225a-4f33-a2b5-d836cad3410e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3525544b-225a-4f33-a2b5-d836cad3410e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3', 'volume_name': 'volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41119597-a553-4dcd-81db-c0edda4c0af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41119597-a553-4dcd-81db-c0edda4c0af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33f24f5-8062-422e-a87e-6a9a72a62a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:16 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Volume cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3', 'volume_size': 1} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417904682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:16Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Creating volume cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:16 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:16 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 1073741824 Sep 08 19:38:16 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:16 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 1073741824" returned: 0 in 0.394s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:16 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:16 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 Sep 08 19:38:16 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:17 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" returned: 0 in 0.252s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33f24f5-8062-422e-a87e-6a9a72a62a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87abb834-ead8-488c-9aa9-eceaa5ae801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:17 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Volume volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 (cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3): created successfully Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87abb834-ead8-488c-9aa9-eceaa5ae801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (5087e890-d3bd-47d0-98b8-9d193367f453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:17 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-7232aea7-a587-450e-9288-f42154dc6be4 tempest-ProjectReaderTests-1185144345 None] Created volume successfully. Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Creating offline snapshot ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 of volume cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a39ea50-4c00-4dce-bdee-3fe46426b861]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:17 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 Sep 08 19:38:17 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:17 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:17 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:17 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 1G Sep 08 19:38:17 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:18 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 1G" returned: 0 in 0.381s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:18 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 Sep 08 19:38:18 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:18 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" returned: 0 in 0.296s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:18 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 is being set with open permissions: ugo+rw Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:18 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 Sep 08 19:38:18 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:18 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:18 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:18 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info Sep 08 19:38:18 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:19 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:19 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info is being set with open permissions: ugo+rw Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:19 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info Sep 08 19:38:19 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:19 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.info" returned: 0 in 0.258s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:19 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-1359eb36-c98d-477d-9021-ea42e3be43f4 tempest-ProjectReaderTests-1185144345 None] Create snapshot completed successfully Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Deleting offline snapshot ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 of volume cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] snapshot_file for this snap is: volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33209e1-8e45-44d6-a392-4c3dc97614d9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:19 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:19 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 Sep 08 19:38:19 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:20 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" returned: 0 in 0.344s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f506548-e246-4c72-adc6-7ff2dd048fec]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:20 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 Sep 08 19:38:20 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:20 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" returned: 0 in 0.357s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:20 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 Sep 08 19:38:20 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:20 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" returned: 0 in 0.332s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:20 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6 Sep 08 19:38:20 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:20 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:20 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3.ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6" released by "_delete_snapshot" :: held 1.355s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" released by "delete_snapshot" :: held 1.377s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Created reservations ['e4872500-6900-4f58-a2e8-3bb624c82bf3', '5312f37e-5bc0-48f0-9e5b-77164880de40', '913de49b-c8e9-425a-91ad-cce02b727d2e', '6cf465d7-85f8-4b5b-b304-b48f0ca26532'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:21 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Delete snapshot completed successfully. Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-81cae63d-9f33-40dd-a58a-3296d5730a37 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-ec678ae7-cbd7-4338-8f2d-595d2a8d8ac6-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "cinder-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c70341-f301-403f-bab2-53dc61c446a7]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:21 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:21 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 Sep 08 19:38:21 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:22 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" returned: 0 in 0.353s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:22 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3 Sep 08 19:38:22 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:22 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" returned: 0 in 0.243s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3" released by "delete_volume" :: held 0.647s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Created reservations ['af040f5e-edb5-4f4b-a3e7-17207b3c9a88', 'ca19af2b-efe4-4376-8ca5-97986d3965c5', '309ee3fc-625e-4e1a-ac50-5a16bb759667', '111e44c6-be83-4f47-91c3-12c6fd7ea654'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:22 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:22 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:22 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.238s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:22 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Deleted volume successfully. Sep 08 19:38:22 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9423afa6-c58a-42d9-8d37-b541df6fc9fa tempest-ProjectReaderTests-1185144345 None] Lock "cinder-cd8cf2ac-3f5a-4b67-81c1-aeb20e4c67b3-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (b15e3e3e-4c7f-4f8b-9ab4-138fce6127cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa141ce4-377d-4783-9ea2-29fbd7acad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa141ce4-377d-4783-9ea2-29fbd7acad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335626672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a8bed1-ecf5-4602-afb4-18f3b8fed212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:23Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36619cca-258a-4d79-a9c0-bbab1010b9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36619cca-258a-4d79-a9c0-bbab1010b9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c49665-a70e-417f-afac-760fe8304900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c49665-a70e-417f-afac-760fe8304900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a8bed1-ecf5-4602-afb4-18f3b8fed212', 'volume_name': 'volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d6b74d-c502-4cb2-9575-056e65ebb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d6b74d-c502-4cb2-9575-056e65ebb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec19b2-c647-46c1-8ade-51f63e07356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:23 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Volume 81a8bed1-ecf5-4602-afb4-18f3b8fed212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212', 'volume_size': 1} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1335626672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a8bed1-ecf5-4602-afb4-18f3b8fed212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:23Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Creating volume 81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:23 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:23 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 1073741824 Sep 08 19:38:23 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:23 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 1073741824" returned: 0 in 0.425s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:23 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:23 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 Sep 08 19:38:23 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:24 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212" returned: 0 in 0.260s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ec19b2-c647-46c1-8ade-51f63e07356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580d25e7-2681-4059-85da-bf744d272295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:24 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Volume volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 (81a8bed1-ecf5-4602-afb4-18f3b8fed212): created successfully Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (580d25e7-2681-4059-85da-bf744d272295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (b15e3e3e-4c7f-4f8b-9ab4-138fce6127cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:24 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8ad96308-5d96-4bad-ad46-80de789bc881 tempest-ProjectReaderTests-1185144345 None] Created volume successfully. Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Creating offline snapshot 9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 of volume 81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad12423-7d9f-4be4-a43c-450076832219]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:24 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 Sep 08 19:38:24 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:24 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212" returned: 0 in 0.351s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:24 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:24 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 1G Sep 08 19:38:24 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:25 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 1G" returned: 0 in 0.388s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:25 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 Sep 08 19:38:25 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:25 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" returned: 0 in 0.287s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:25 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 is being set with open permissions: ugo+rw Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:25 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 Sep 08 19:38:25 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:25 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:25 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:25 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info Sep 08 19:38:25 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:26 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info" returned: 0 in 0.251s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:26 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info is being set with open permissions: ugo+rw Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:26 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info Sep 08 19:38:26 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:26 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.info" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.837s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:26 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-0b850058-904c-468c-9099-3cf2d60435ec tempest-ProjectReaderTests-1185144345 None] Create snapshot completed successfully Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Deleting offline snapshot 9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 of volume 81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] snapshot_file for this snap is: volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[98569bbb-a4f0-4e1c-aa2b-afcc6324d6a9]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:26 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:26 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 Sep 08 19:38:26 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:27 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ea012c-7250-4d5d-b56b-ff1e45263964]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:27 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 Sep 08 19:38:27 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:27 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212" returned: 0 in 0.356s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:27 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 Sep 08 19:38:27 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:27 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" returned: 0 in 0.326s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:27 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1 Sep 08 19:38:27 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:27 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:27 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212.9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1" released by "_delete_snapshot" :: held 1.360s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" released by "delete_snapshot" :: held 1.384s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Created reservations ['e6b6646a-86b4-4f9b-9552-9780bb09984f', 'b5b81f1a-0b9e-4729-9fc2-18fd12c51623', '12a75b76-752c-44df-94cd-eab601967d92', 'c88bdc29-be8c-4e3c-a099-382e6626a3ec'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:28 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Delete snapshot completed successfully. Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-17f85860-97be-48e7-9a65-921425fb47fd tempest-ProjectReaderTests-1185144345 None] Lock "cinder-9bbdae86-7cc2-49e4-9dab-b9aeb7e1e2b1-delete_snapshot" released by "delete_snapshot" :: held 1.510s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-81a8bed1-ecf5-4602-afb4-18f3b8fed212-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-81a8bed1-ecf5-4602-afb4-18f3b8fed212-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a546aba-2360-44ec-8383-667686a4281c]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:28 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:28 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 Sep 08 19:38:28 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:29 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212" returned: 0 in 0.364s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:29 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212 Sep 08 19:38:29 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:29 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-81a8bed1-ecf5-4602-afb4-18f3b8fed212" returned: 0 in 0.239s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-81a8bed1-ecf5-4602-afb4-18f3b8fed212" released by "delete_volume" :: held 0.661s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Created reservations ['f884579f-35f6-4937-b446-1fb1e75f5f63', '8e265b81-cdea-45fc-a99f-6c81a5fb2c8c', '0364df9b-5656-4a47-ae6a-967161530fe7', 'efd037ba-84ae-4a6e-8358-c39214f4a021'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:29 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:29 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:29 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.241s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:29 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Deleted volume successfully. Sep 08 19:38:29 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-9c4b4cd9-7500-4f08-a219-afd4e62ddb76 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-81a8bed1-ecf5-4602-afb4-18f3b8fed212-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (69dbc18a-f83e-498c-be10-5e686481652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc6258-38f2-40a4-b153-5dbb6411b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1fc6258-38f2-40a4-b153-5dbb6411b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273631591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3045e6-6d29-4bab-a30e-b08711ddbefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:30Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901ed01b-9892-4fbe-b7ba-b16ac0859a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (901ed01b-9892-4fbe-b7ba-b16ac0859a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057adfb2-aa8e-4ed2-9440-691623bd1073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (057adfb2-aa8e-4ed2-9440-691623bd1073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3045e6-6d29-4bab-a30e-b08711ddbefc', 'volume_name': 'volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5489c379-3225-49b8-96c4-9de161eeb2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5489c379-3225-49b8-96c4-9de161eeb2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c419c1a8-994e-4d8b-987a-9c543e3339da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:30 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Volume 0d3045e6-6d29-4bab-a30e-b08711ddbefc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc', 'volume_size': 1} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273631591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3045e6-6d29-4bab-a30e-b08711ddbefc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:30Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Creating volume 0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:30 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:30 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc 1073741824 Sep 08 19:38:30 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:30 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc 1073741824" returned: 0 in 0.398s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:30 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:30 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc Sep 08 19:38:30 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:31 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc" returned: 0 in 0.244s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c419c1a8-994e-4d8b-987a-9c543e3339da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0c5b25-0f75-4d62-b9dd-bdf9fba6a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:31 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Volume volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc (0d3045e6-6d29-4bab-a30e-b08711ddbefc): created successfully Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0c5b25-0f75-4d62-b9dd-bdf9fba6a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (69dbc18a-f83e-498c-be10-5e686481652e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:31 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-88087091-d084-4105-8a72-0705e4dc822b tempest-ProjectReaderTests-1185144345 None] Created volume successfully. Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Creating offline snapshot 1f22cf3c-b78f-4898-96e5-1ef66e77afde of volume 0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7973e5-647f-4987-80c1-dfc9049412e6]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:31 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc Sep 08 19:38:31 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:31 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc" returned: 0 in 0.343s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:31 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:31 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde 1G Sep 08 19:38:31 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:32 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde 1G" returned: 0 in 0.378s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:32 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde Sep 08 19:38:32 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:32 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde" returned: 0 in 0.285s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:32 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde is being set with open permissions: ugo+rw Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:32 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde Sep 08 19:38:32 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:32 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:32 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:32 devstack sudo[108609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info Sep 08 19:38:32 devstack sudo[108609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:33 devstack sudo[108609]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:33 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info is being set with open permissions: ugo+rw Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:33 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info Sep 08 19:38:33 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:33 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.info" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.812s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:33 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-d6112295-6a25-49b3-927f-abeef420cf37 tempest-ProjectReaderTests-1185144345 None] Create snapshot completed successfully Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-1f22cf3c-b78f-4898-96e5-1ef66e77afde-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-1f22cf3c-b78f-4898-96e5-1ef66e77afde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-1f22cf3c-b78f-4898-96e5-1ef66e77afde" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-1f22cf3c-b78f-4898-96e5-1ef66e77afde" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Deleting offline snapshot 1f22cf3c-b78f-4898-96e5-1ef66e77afde of volume 0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] snapshot_file for this snap is: volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15b90c-4942-4922-9958-3b22d07d8fbf]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:33 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:33 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde Sep 08 19:38:33 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:34 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde" returned: 0 in 0.345s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5971b7f-74a2-46fc-9920-c53832c762e5]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:34 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc Sep 08 19:38:34 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:34 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc" returned: 0 in 0.348s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:34 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde Sep 08 19:38:34 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:34 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:34 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde Sep 08 19:38:34 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:34 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:34 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc.1f22cf3c-b78f-4898-96e5-1ef66e77afde" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-1f22cf3c-b78f-4898-96e5-1ef66e77afde" released by "_delete_snapshot" :: held 1.354s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" released by "delete_snapshot" :: held 1.374s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Created reservations ['1f87e23e-d596-4f2b-b5e6-350e4c4d5d76', '8583eb6c-ccd5-49a3-8d79-14e1fe413fa8', '48e009c9-de78-48ca-9260-dc889a23fbc6', '7c7d10aa-20cd-4452-b819-a996193995df'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:35 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Delete snapshot completed successfully. Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-8488a4bd-1c96-4d3d-9d84-2854fe16587c tempest-ProjectReaderTests-1185144345 None] Lock "cinder-1f22cf3c-b78f-4898-96e5-1ef66e77afde-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-0d3045e6-6d29-4bab-a30e-b08711ddbefc-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-0d3045e6-6d29-4bab-a30e-b08711ddbefc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" acquired by "delete_volume" :: waited 0.015s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[edee8a75-ea5a-4ae4-a893-e2ed4b28a391]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:35 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:35 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc Sep 08 19:38:35 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:36 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc" returned: 0 in 0.352s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:36 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc Sep 08 19:38:36 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:36 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-0d3045e6-6d29-4bab-a30e-b08711ddbefc" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-0d3045e6-6d29-4bab-a30e-b08711ddbefc" released by "delete_volume" :: held 0.639s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Created reservations ['dedf85d1-5b13-402b-94eb-daafca900b44', 'cbfc3c1f-752e-4e13-a112-7d42ef1b7c4c', 'f08b43e0-719c-440a-aa11-55cd548ea94f', '7497f383-46c7-4c80-9709-929d96449e2e'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:36 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:36 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:36 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.235s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:36 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Deleted volume successfully. Sep 08 19:38:36 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-5d37a32d-2934-4d22-8943-d5fe76ddca88 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-0d3045e6-6d29-4bab-a30e-b08711ddbefc-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (429b7818-47a2-4ec0-bbf1-b67976966f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f58ac2-e5e6-4922-aeee-b156f087f597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f58ac2-e5e6-4922-aeee-b156f087f597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211323410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cbddec-0f57-4edb-82ec-fcc2947e5679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:37Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac09aa-663d-4ca4-9a3d-66a6cd894cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ac09aa-663d-4ca4-9a3d-66a6cd894cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68066a0-dcfb-43a3-bd22-819d242e389e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b68066a0-dcfb-43a3-bd22-819d242e389e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6cbddec-0f57-4edb-82ec-fcc2947e5679', 'volume_name': 'volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0c5a0a-98dc-4624-b0d3-bffa67cef223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0c5a0a-98dc-4624-b0d3-bffa67cef223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb25f14-5a54-43bf-a2f8-ea5b5060547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:37 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Volume d6cbddec-0f57-4edb-82ec-fcc2947e5679: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679', 'volume_size': 1} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-211323410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cbddec-0f57-4edb-82ec-fcc2947e5679,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357170d5acf343a793af792977954522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:37Z,use_quota=True,user_id='389544bd2db14f3da9180dbee6a78799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Creating volume d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:37 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:37 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 1073741824 Sep 08 19:38:37 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:37 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 1073741824" returned: 0 in 0.393s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:37 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:37 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 Sep 08 19:38:37 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:38 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb25f14-5a54-43bf-a2f8-ea5b5060547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b0c154-e78d-4d6e-aa8f-961960e1b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:38 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Volume volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 (d6cbddec-0f57-4edb-82ec-fcc2947e5679): created successfully Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54b0c154-e78d-4d6e-aa8f-961960e1b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Flow 'volume_create_manager' (429b7818-47a2-4ec0-bbf1-b67976966f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:38 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-3c8cf67f-3388-4ad8-beec-ac39b82f242d tempest-ProjectReaderTests-1185144345 None] Created volume successfully. Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Creating offline snapshot 04d444c3-a56f-4ecd-ab51-6f01cabcfba6 of volume d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a56e94-e68f-440c-bf71-ad4ae7ae4b1b]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:38 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 Sep 08 19:38:38 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:38 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679" returned: 0 in 0.340s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:38 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 1G {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:38 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 1G Sep 08 19:38:38 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:39 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 1G" returned: 0 in 0.376s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:39 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 Sep 08 19:38:39 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:39 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 -F qcow2 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6" returned: 0 in 0.283s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:39 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 is being set with open permissions: ugo+rw Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:39 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 Sep 08 19:38:39 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:39 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:39 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:39 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info Sep 08 19:38:39 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:40 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info" returned: 0 in 0.240s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:40 devstack cinder-volume[87521]: WARNING cinder.volume.drivers.remotefs [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info is being set with open permissions: ugo+rw Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:40 devstack sudo[108680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info Sep 08 19:38:40 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:40 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.info" returned: 0 in 0.246s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:40 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-5fc1fb45-38a0-45d8-96aa-6fabea691bdb tempest-ProjectReaderTests-1185144345 None] Create snapshot completed successfully Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-04d444c3-a56f-4ecd-ab51-6f01cabcfba6-delete_snapshot" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-04d444c3-a56f-4ecd-ab51-6f01cabcfba6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" by "delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-04d444c3-a56f-4ecd-ab51-6f01cabcfba6" by "_delete_snapshot" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-04d444c3-a56f-4ecd-ab51-6f01cabcfba6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Deleting offline snapshot 04d444c3-a56f-4ecd-ab51-6f01cabcfba6 of volume d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] snapshot_file for this snap is: volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8cfbe-2bc2-4305-9911-771c62bd4324]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:40 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:40 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 Sep 08 19:38:40 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:41 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6" returned: 0 in 0.350s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87521) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc3d7d-b988-464d-8a8a-3cf26b883dae]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:41 devstack sudo[108688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 Sep 08 19:38:41 devstack sudo[108688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:41 devstack sudo[108688]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679" returned: 0 in 0.348s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:41 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 Sep 08 19:38:41 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:41 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6" returned: 0 in 0.336s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:41 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:41 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6 Sep 08 19:38:41 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:41 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679.04d444c3-a56f-4ecd-ab51-6f01cabcfba6" returned: 0 in 0.245s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-04d444c3-a56f-4ecd-ab51-6f01cabcfba6" released by "_delete_snapshot" :: held 1.362s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" released by "delete_snapshot" :: held 1.388s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Created reservations ['be4ce644-8575-4835-bb95-d750d4b614dd', 'c9c4e488-ba7f-4eba-81ce-fcc8f4cf00ae', 'd3536b46-e1f5-431c-86b2-62f5a124e967', 'bfe4e853-d655-482b-bb61-8c28f6487996'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:42 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Delete snapshot completed successfully. Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-2681f6da-e002-40e3-b96e-dcfc85a29ac4 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-04d444c3-a56f-4ecd-ab51-6f01cabcfba6-delete_snapshot" released by "delete_snapshot" :: held 1.524s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-d6cbddec-0f57-4edb-82ec-fcc2947e5679-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-d6cbddec-0f57-4edb-82ec-fcc2947e5679-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d9d41-0246-4f5c-aba2-712361266c00]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:42 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:42 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 Sep 08 19:38:42 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:43 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679" returned: 0 in 0.362s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:43 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679 Sep 08 19:38:43 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:43 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-d6cbddec-0f57-4edb-82ec-fcc2947e5679" returned: 0 in 0.255s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-quobyte-d6cbddec-0f57-4edb-82ec-fcc2947e5679" released by "delete_volume" :: held 0.671s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Created reservations ['b13b761d-31bc-4f8e-ac88-e7b77ed90cc9', 'a2831e60-4f61-4c0b-8b5c-de3ffe11bbaa', '40ee268f-e257-42d9-9be4-781e057af9fb', '6e5cd7be-7edf-4b8b-bc74-e29a827ec753'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:43 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:43 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:43 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.236s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:43 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Deleted volume successfully. Sep 08 19:38:43 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-fa74e277-5500-47e4-8294-f619ef1641a2 tempest-ProjectReaderTests-1185144345 None] Lock "cinder-d6cbddec-0f57-4edb-82ec-fcc2947e5679-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Flow 'volume_create_manager' (ed603fbc-9839-4e65-a8b6-e8c93c503202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a310b3c-045e-4bc1-8233-453f27eabb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a310b3c-045e-4bc1-8233-453f27eabb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52214921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355434a4-dcc5-4dcb-8fce-2bbe0ee41105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ebb3aab08a4ddcacfb14aec2d6db11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:47Z,use_quota=True,user_id='4ec6d54c1cfc4ce28d72716f5d68275c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d927615-b0cc-42cf-ad75-884e48a92169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d927615-b0cc-42cf-ad75-884e48a92169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7702a82-f28b-41f8-9b9a-544aa76ad681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7702a82-f28b-41f8-9b9a-544aa76ad681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355434a4-dcc5-4dcb-8fce-2bbe0ee41105', 'volume_name': 'volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866f3add-f668-41af-904b-966a8f3da4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866f3add-f668-41af-904b-966a8f3da4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada5300-af6a-4ab9-8730-45aa1a9bbc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:47 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Volume 355434a4-dcc5-4dcb-8fce-2bbe0ee41105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105', 'volume_size': 1} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-52214921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355434a4-dcc5-4dcb-8fce-2bbe0ee41105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ebb3aab08a4ddcacfb14aec2d6db11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:47Z,use_quota=True,user_id='4ec6d54c1cfc4ce28d72716f5d68275c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Creating volume 355434a4-dcc5-4dcb-8fce-2bbe0ee41105 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:47 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:47 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 1073741824 Sep 08 19:38:47 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:47 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 1073741824" returned: 0 in 0.387s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=141,cinder:DELETE=15,cinder:SELECT=103,cinder:INSERT=37 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:38:47 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:47 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 Sep 08 19:38:47 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:48 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" returned: 0 in 0.247s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=117,cinder:INSERT=42,cinder:UPDATE=144,cinder:DELETE=8 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada5300-af6a-4ab9-8730-45aa1a9bbc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50940912-86b2-4739-b8a5-d0cbf6cc5594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:48 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Volume volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 (355434a4-dcc5-4dcb-8fce-2bbe0ee41105): created successfully Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50940912-86b2-4739-b8a5-d0cbf6cc5594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Flow 'volume_create_manager' (ed603fbc-9839-4e65-a8b6-e8c93c503202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:48 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-868845d8-1555-42df-84d6-02c72a7c8642 tempest-ProjectReaderTests-177296253 None] Created volume successfully. Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Acquiring lock "cinder-355434a4-dcc5-4dcb-8fce-2bbe0ee41105-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "cinder-355434a4-dcc5-4dcb-8fce-2bbe0ee41105-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Acquiring lock "cinder-quobyte-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "cinder-quobyte-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dfed4e-9b45-4b28-a329-14acadab0f3e]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:48 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:48 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 Sep 08 19:38:48 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:49 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:49 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105 Sep 08 19:38:49 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:49 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" returned: 0 in 0.253s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "cinder-quobyte-355434a4-dcc5-4dcb-8fce-2bbe0ee41105" released by "delete_volume" :: held 0.641s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Created reservations ['fdbb4cc6-aa39-4431-a5d8-e67c8fe30000', '1c1ce225-63dc-4bf8-9527-74e11c8efb2a', 'd65c5858-1404-42ec-b1f5-54161772f4f0', '955d46cc-07a3-4d96-a365-56fe29f94886'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:49 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:49 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:49 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.237s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:49 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Deleted volume successfully. Sep 08 19:38:49 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-a81f6053-65b5-4713-b577-74167bb6dbbc tempest-ProjectReaderTests-177296253 None] Lock "cinder-355434a4-dcc5-4dcb-8fce-2bbe0ee41105-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87521) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Flow 'volume_create_manager' (2ea9422e-8a9a-4c53-a596-ab6873119683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d836e04-c417-44c7-a235-8b2b5e834bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d836e04-c417-44c7-a235-8b2b5e834bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133208945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54435b3-871a-48cd-ba41-5cf2d1d1bf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ebb3aab08a4ddcacfb14aec2d6db11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:50Z,use_quota=True,user_id='4ec6d54c1cfc4ce28d72716f5d68275c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128ee116-350d-4db5-8d1e-074e73ef88c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128ee116-350d-4db5-8d1e-074e73ef88c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e34182-e99d-490e-822c-3e62531d0119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48e34182-e99d-490e-822c-3e62531d0119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54435b3-871a-48cd-ba41-5cf2d1d1bf41', 'volume_name': 'volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e311f499-3c52-4d3c-868c-18aea4f82f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e311f499-3c52-4d3c-868c-18aea4f82f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df352ca4-2fe5-428f-9ea6-7406d6c7eefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Volume b54435b3-871a-48cd-ba41-5cf2d1d1bf41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41', 'volume_size': 1} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-08T17:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-133208945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54435b3-871a-48cd-ba41-5cf2d1d1bf41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ebb3aab08a4ddcacfb14aec2d6db11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-08T17:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-08T17:38:50Z,use_quota=True,user_id='4ec6d54c1cfc4ce28d72716f5d68275c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(546dfdb4-908a-4d31-86f7-77e4ae606025),volume_type_id=546dfdb4-908a-4d31-86f7-77e4ae606025)}" {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.remotefs [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Creating volume b54435b3-871a-48cd-ba41-5cf2d1d1bf41 {{(pid=87521) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Selected osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 as target Quobyte volume. {{(pid=87521) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 08 19:38:50 devstack cinder-volume[87521]: INFO cinder.volume.drivers.remotefs [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] casted to osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904 Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 1073741824 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:50 devstack sudo[108770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 1073741824 Sep 08 19:38:50 devstack sudo[108770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:50 devstack sudo[108770]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 1073741824" returned: 0 in 0.397s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:50 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 Sep 08 19:38:50 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:50 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" returned: 0 in 0.233s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'} {{(pid=87521) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df352ca4-2fe5-428f-9ea6-7406d6c7eefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41', 'volume_size': 1}' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3e94d3-ec49-4004-89a9-f064e41108c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 08 19:38:50 devstack cinder-volume[87521]: INFO cinder.volume.flows.manager.create_volume [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Volume volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 (b54435b3-871a-48cd-ba41-5cf2d1d1bf41): created successfully Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3e94d3-ec49-4004-89a9-f064e41108c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87521) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 08 19:38:50 devstack cinder-volume[87521]: DEBUG cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Flow 'volume_create_manager' (2ea9422e-8a9a-4c53-a596-ab6873119683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87521) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 08 19:38:50 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-dd727684-cc35-4bf4-aed5-9e5a1afc19f7 tempest-ProjectReaderTests-177296253 None] Created volume successfully. Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Acquiring lock "cinder-b54435b3-871a-48cd-ba41-5cf2d1d1bf41-delete_volume" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "cinder-b54435b3-871a-48cd-ba41-5cf2d1d1bf41-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Acquiring lock "cinder-quobyte-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" by "delete_volume" {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "cinder-quobyte-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" acquired by "delete_volume" :: waited 0.017s {{(pid=87521) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec8d3d-10ae-403d-ab77-2104bb8b6fe3]: (4, 'qcow2') {{(pid=88727) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:51 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 Sep 08 19:38:51 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:51 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" returned: 0 in 0.354s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:51 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41 Sep 08 19:38:51 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:51 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10/volume-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" returned: 0 in 0.233s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "cinder-quobyte-b54435b3-871a-48cd-ba41-5cf2d1d1bf41" released by "delete_volume" :: held 0.623s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:38:51 devstack cinder-volume[87521]: DEBUG cinder.quota [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Created reservations ['c9c995b4-fa16-4b2e-9a6b-e82c5a9a9694', '7b1826dd-801e-4b7d-9f4b-70a7b8abe733', '12e35f87-4f73-4a02-b84d-d9214f566f41', 'ace5c4d5-8ad5-4199-a92a-ffe0c5322d0f'] {{(pid=87521) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904': None} {{(pid=87521) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG cinder.volume.drivers.quobyte [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4732eaf-48f9-491f-a8eb-b4a910a85904'] {{(pid=87521) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.lockutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87521) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 08 19:38:52 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10 Sep 08 19:38:52 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 08 19:38:52 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG oslo_concurrency.processutils [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a0178f0d737b69cfde60fbe1d0bcdb10" returned: 0 in 0.242s {{(pid=87521) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG cinder.manager [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Notifying Schedulers of capabilities ... {{(pid=87521) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 08 19:38:52 devstack cinder-volume[87521]: INFO cinder.volume.manager [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Deleted volume successfully. Sep 08 19:38:52 devstack cinder-volume[87521]: DEBUG cinder.coordination [None req-855a750c-93df-4cca-9066-42eb720efa28 tempest-ProjectReaderTests-177296253 None] Lock "cinder-b54435b3-871a-48cd-ba41-5cf2d1d1bf41-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87521) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 08 19:39:02 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:UPDATE=23,cinder:DELETE=1,cinder:SELECT=8,cinder:INSERT=5 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 08 19:39:02 devstack cinder-volume[87521]: DEBUG dbcounter [-] [87521] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87521) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}